Research on factors affecting quality of mobile application crowdsourced testing

doi:10.11772/j.issn.1001-9081.2018030575

Journal of Computer Applications ›› 2018, Vol. 38 ›› Issue (9): 2626-2630.DOI: 10.11772/j.issn.1001-9081.2018030575

Previous Articles Next Articles

Research on factors affecting quality of mobile application crowdsourced testing

CHENG Jing¹, GE Luqi², ZHANG Tao², LIU Ying², ZHANG Yifei³

1. School of Computer Science and Engineering, Xi'an Technological University, Xi'an Shaanxi 710021, China;
2. College of Software and Microelectronics, Northwestern Polytechnical University, Xi'an Shaanxi 710072, China;
3. School of Computer Science, Northwestern Polytechnical University, Xi'an Shaanxi 710068, China

Received:2018-03-21 Revised:2018-04-23 Online:2018-09-10 Published:2018-09-06
Contact: 成静
Supported by:
This work is partially supported by the Industrial Science and Technology Research Project of Shaanxi Province (2016GY-100), the Xi'an Science and Technology Project (XAGY016), the Research Program of Shaanxi Education Department.

移动应用众包测试质量影响因素分析

成静¹, 葛璐琦², 张涛², 刘莹², 张逸飞³

1. 西安工业大学计算机科学与工程学院, 西安 710021;
2. 西北工业大学软件与微电子学院, 西安 710072;
3. 西北工业大学计算机学院, 西安 710068

通讯作者: 成静
作者简介:成静(1982—),女,陕西西安人,讲师,博士,主要研究方向:软件测试;葛璐琦(1994—),女,陕西西安人,硕士研究生,主要研究方向:软件安全性、移动应用测试;张涛(1976—),男,陕西宝鸡人,副教授,博士,主要研究方向:软件安全性、移动应用测试;刘莹(1996—),女,四川绵阳人,硕士研究生,主要研究方向:移动应用测试、众包测试;张逸飞(1993—),男,陕西西安人,硕士研究生,主要研究方向:软件建模、分析、测试、调试技术,图形处理。
基金资助:
陕西省工业科技攻关项目（2016GY-100）；西安市科技计划项目（XAGY016）；陕西省教育厅科研计划项目。

Abstract

Abstract: To solve the problem that the influencing factors of crowdsourced testing are complex and diverse, and the test quality is difficult to assess, a method for analyzing the quality influencing factors based on Spearman correlation coefficient was proposed. Firstly, the potential quality influencing factors were obtained through the analysis of test platforms, tasks, and testers. Secondly, Spearman correlation coefficient was used to calculate the correlation degrees between potential factors and test quality and to screen out key factors. Finally, the multiple stepwise regression was used to establish a linear evaluation relationship between key factors and test quality. The experimental results show that compared with the traditional expert artificial evaluation method, the proposed method can maintain smaller fluctuations in evaluation error when facing a large number of test tasks. Therefore, the method can accurately screen out the key influencing factors of mobile application crowdsourced test quality.

Key words: mobile application crowdsourced testing, quality influencing factor, Spearman correlation coefficient, stepwise regression

摘要： 针对移动应用众包测试质量影响因素复杂多样致使测试质量难以评估的问题，提出一种基于皮斯尔曼相关系数分析的质量影响因素分析方法。首先，通过对测试平台、任务、人员三方面的分析获取潜在质量影响因素；然后，利用斯皮尔曼相关系数分析法计算潜在因素与测试质量的关联程度并筛选出强关联因素；最后，通过多元逐步回归法建立强关联因素与测试质量间的线性评价关系。实验结果表明，与传统专家人工评价方式相比，所提方法在面向大量测试任务质量评价时，能够保持更小的评价误差波动，可以准确地筛选出移动应用众包测试质量关键影响因素。

关键词: 移动应用众包测试, 质量影响因素, 斯皮尔曼相关系数, 逐步回归法

CLC Number:

TP301.4

CHENG Jing, GE Luqi, ZHANG Tao, LIU Ying, ZHANG Yifei. Research on factors affecting quality of mobile application crowdsourced testing[J]. Journal of Computer Applications, 2018, 38(9): 2626-2630.

成静, 葛璐琦, 张涛, 刘莹, 张逸飞. 移动应用众包测试质量影响因素分析[J]. 计算机应用, 2018, 38(9): 2626-2630.

References

[1] MAO K, CAPRA L, HARMAN M, et al. A survey of the use of crowdsourcing in software engineering[EB/OL].[2018-01-02]. http://www0.cs.ucl.ac.uk/staff/K.Mao/archive/p_jss_crowdsourcing_survey.pdf.
[2] 童咏昕,袁野,成雨蓉,等.时空众包数据管理技术研究综述[J].软件学报,2017,28(1):35-58.(TONG Y X, YUAN Y, CHENG Y R, et al. Survey on spatiotemporal crowdsourced data management techniques[J]. Journal of Software, 2017, 28(1):35-58.)
[3] 芮兰兰,张攀,黄豪球,等.一种面向众包的基于信誉值的激励机制[J].电子与信息学报,2016,38(7):1808-1815.(RUI L L, ZHANG P, HUANG H Q, et al. Reputation-based incentive mechanisms in crowdsourcing[J]. Journal of Electronics and Information Technology, 2016, 38(7):1808-1815.)
[4] 阮闪闪,王小平,薛小平.基于证据理论信任模型的众包质量监控[J].计算机应用,2015,35(8):2380-2385.(RUAN S S, WANG X P, XUE X P. Crowdsourcing quality control based on reputation model of Dempster-Shafer theory[J]. Journal of Computer Applications, 2015, 35(8):2380-2385.)
[5] 肖江辉.基于可信度的众包协同测试及其算法实现[D].大连:大连海事大学,2015:7-9.(XIAO J H. A research on trust-based crowdsourced collaborative testing and algorithm implementation[J]. Dalian:Dalian Maritime University, 2015:7-9.)
[6] 朱旋,杨麦顺,安健,等.群智感知中基于反拍卖模型的众包激励方法[J].计算机应用,2016,36(7):2038-2045.(ZHU X, YANG M S, AN J, et al. Crowdsourcing incentive method based on reverse auction in crowd sensing[J]. Journal of Computer Applications, 2016, 36(7):2038-2045.)
[7] ZHANG X, YANG Z, ZHOU Z. Free market of crowdsourcing:incentive mechanism design for mobile sensing[J]. IEEE Transactions on Parallel and Distributed Systems, 2014, 25(12):3190-3200.
[8] WEN Y, SHI J, ZHANG Q, et al. Quality-driven auction-based incentive mechanism for mobile crowd sensing[J]. IEEE Transactions on Vehicular Technology, 2014, 64(9):4203-4214.
[9] XIE M, WANG Q, CUI Q, et al. CQM:coverage-constrained quality maximization in crowdsourcing test[C]//ICSE-C'17:Proceedings of the 39th International Conference on Software Engineering Companion. Piscataway, NJ:IEEE, 2017:192-194.
[10] LEASE M, CARVALHO V R, YILMAZ E. Crowdsourcing for search and datamining[J]. ACM SIGIR Forum, 2011, 45(1):18-24.
[11] 张志强,逄居升,谢晓芹,等.众包质量控制策略及评估算法研究[J].计算机学报,2013,36(8):1636-1649.(ZHANG Z Q, PANG J S, XIE X Q, et al. Research on crowdsourcing quality control strategies and evaluation algorithm[J]. Chinese Journal of Computers, 2013, 36(8):1636-1649.)
[12] GAO L, HOU F, HUANG J. Providing long-term participation incentive in participatory sensing[C]//Proceedings of the 2015 IEEE Conference on Computer Communications. Piscataway, NJ:IEEE, 2015:2803-2811.

Research on factors affecting quality of mobile application crowdsourced testing

移动应用众包测试质量影响因素分析

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 2

Recommended Articles

Metrics

[1]	LIU Ying, ZHANG Tao, LI Kun, LI Nan. Evaluation model of mobile application crowdsourcing testers [J]. Journal of Computer Applications, 2017, 37(12): 3569-3573.
[2]	ZHOU Yueyue, HU Jie, SU Tao. Fuzzy clustering algorithm based on midpoint density function [J]. Journal of Computer Applications, 2016, 36(1): 150-153.