Journals
  Publication Years
  Keywords
Search within results Open Search
Please wait a minute...
For Selected: Toggle Thumbnails
Expert counter-evaluation model with three-way decision and entropy weight TOPSIS
Ying YU, Feng ZHU, Hongjian FU, Yiwen LUO, Jin QIAN, Yuchao ZHENG
Journal of Computer Applications    2025, 45 (5): 1424-1431.   DOI: 10.11772/j.issn.1001-9081.2024060819
Abstract69)   HTML2)    PDF (1671KB)(366)       Save

During the evaluation and review process of scientific and technological projects, the quality of evaluation and review conducted by experts significantly influences the accuracy and credibility of the final evaluation results. To ensure the fairness and objectivity of the evaluation results, it is necessary to conduct a counter-evaluation of the evaluation experts. By analyzing three aspects including the basic personal situation, professional level and evaluation performance of evaluation experts, an evaluation index system for counter-evaluation of experts was constructed. Based on this, an expert counter-evaluation model that combined three-way decisions and entropy weight based Technique for Order Preference by Similarity to Ideal Solution (TOPSIS) was proposed, which used the three-way decision theory to solve the problem of weight distortion due to the over-reliance of entropy weight method on data. When the index weights were abnormal, the group of experts to be evaluated was divided into positive, negative and boundary domains according to the threshold, and then the expert-in, expert-out and delayed evaluation strategies were adopted respectively. Once the index weights were normal or corrected, TOPSIS was used to rank the evaluation experts. Through empirical analysis of the historical evaluation and review data of scientific and technological projects from an enterprise, it can be seen that the proposed model can integrate the empirical judgment of decision makers with inherent information of the experts to be evaluated to realize the unity of subjectivity and objectivity, ensuring a scientific and fair evaluation of the evaluation experts, and providing decision-making references for construction of a high-quality expert database.

Table and Figures | Reference | Related Articles | Metrics