Journal of Computer Applications ›› 2015, Vol. 35 ›› Issue (8): 2380-2385.DOI: 10.11772/j.issn.1001-9081.2015.08.2380

Previous Articles     Next Articles

Crowdsourcing quality control based on reputation model of Dempster-Shafer theory

RUAN Shanshan, WANG Xiaoping, XUE Xiaoping   

  1. School of Electronics and Information Engineering, Tongji University, Shanghai 201804, China
  • Received:2015-01-27 Revised:2015-03-12 Online:2015-08-10 Published:2015-08-14


阮闪闪, 王小平, 薛小平   

  1. 同济大学 电子与信息工程学院, 上海 201804
  • 通讯作者: 阮闪闪(1991-),女,安徽合肥人,硕士研究生,主要研究方向:软件与信息服务,
  • 作者简介:王小平(1965-),男,江苏扬中人,教授,博士,主要研究方向:软件与信息服务、分布式智能系统、复杂适应系统、自然计算; 薛小平(1963-),男,江苏常州人,教授,博士,主要研究方向:网络与分布式计算。
  • 基金资助:



Since the existing crowdsourcing model could not detect the malicious behavior in the crowdsourcing system quickly and efficiently, a reputation model based on Dempster-Shafer theory, called DS_CQC (Dempster/Shafer Crowdsoucing Quality Control), was proposed to apply to the crowdsourcing quality control. Firstly, the sustainable credible evidence sequence and sustained incredible evidence sequence based on time-window were obtained. Secondly, the original D-S evidence theory was improved through three aspects including importance of evidence, relationship of evidence and reliability of witness, and the new basic probability function was acquired. Finally, evidence sequence was fused by using the improved D-S evidence theory and then the direct reputation, indirect reputation and comprehensive reputation were computed. The incentive mechanism based on reputation was used to encourage people to participate in crowdsourcing actively and submit a higher quality crowd, while the malicious workers were suppressed. Experiments on simulation and real crowd data were conducted, and compared to the trust model of probability, the detection of malicious behavior in the crowdsourcing system of DS_CQC increased by 50% in speed and 3.1% in efficiency at least. The result proves that the DS_CQC has the high anti-attacking capability.

Key words: crowdsourcing, quality control, Dempster-Shafer (D-S) theory, trust model, malicious detection, anti-attacking



关键词: 众包, 质量监控, 证据理论, 信任模型, 恶意检测, 抗攻击

CLC Number: