• •    

移动应用众包测试人员评价模型研究

刘莹,张涛,李坤,李楠   

  1. 西北工业大学
  • 收稿日期:2017-05-24 修回日期:2017-07-24 发布日期:2017-07-24
  • 通讯作者: 刘莹

Research on Evaluation of Mobile Application Crowdsourcing Testers Model

  • Received:2017-05-24 Revised:2017-07-24 Online:2017-07-24

摘要: 移动应用众包测试人员具有匿名、非契约的特性,这使得任务发布者难以准确评估众包测试人员的能力与测试质量。针对该问题,本文提出了一种移动应用众包测试人员层次分析评价模型,该模型从活跃度、测试能力、诚信度等多指标分层综合评估众包测试人员能力,通过构造对比矩阵、一致性检验计算各层次指标的组合权重向量。并引入需求列表与描述列表改进本模型,使测试人员与众包任务更加匹配。实验验证表明,该模型能够实现对测试人员能力的准确评估,支持基于评估结果的众包测试人员选择与推荐,提高移动应用众包测试效率与质量。

关键词: 移动应用众包测试, 人员评价, 层次分析法, 皮尔逊相关性系数, 斯皮尔曼相关系数

Abstract: Abstract: Mobile application crowdsourcing testers are anonymous, non-contractual, which makes it difficult to assess the capabilities of testers and quality of test results.To solve these problems, the evaluation of mobile application crowdsouring testers model was proposed, which evaluated the ability of crowdsourcing testers by means of activity degree, test ability, integrity degree and so on. Comparison matrix and consistency test were constructed to calculate the weight vector of each level.Then requirement list and description list were applied to optimize the proposed model.The simulation results show that the proposed model can evaluate the capabilities of testers accurately, support the selection of crowdsourcing testers based on the evaluation results, and improve the efficiency and quality of mobile application test.

Key words: mobile application crowdsourcing testing, personnel evaluation, analytic hierarchy process, Pearson correlation coefficient, Spearman correlation coefficient

中图分类号: