基于变异分析的测试用例约简方法

doi:10.11772/j.issn.1001-9081.2017.12.3592

计算机应用 ›› 2017, Vol. 37 ›› Issue (12): 3592-3596.DOI: 10.11772/j.issn.1001-9081.2017.12.3592

基于变异分析的测试用例约简方法

王曙燕, 陈朋媛, 孙家泽

西安邮电大学计算机学院, 西安 710061

收稿日期:2017-06-12 修回日期:2017-08-04 出版日期:2017-12-10 发布日期:2017-12-18
通讯作者: 王曙燕
作者简介:王曙燕(1964-),女,陕西西安人,教授,博士,主要研究方向:软件测试、数据挖掘、智能信息处理;陈朋媛(1991-),女,陕西西安人,硕士研究生,主要研究方向:软件测试、数据挖掘;孙家泽(1980-),男,陕西西安人,副教授,博士,主要研究方向:软件测试、数据挖掘、智能信息处理。
基金资助:
陕西省工业科技攻关项目（2017GY-092）；陕西省教育厅自然科学基金项目（15JK1678）。

Reduction method of test suites based on mutation analysis

WANG Shuyan, CHEN Pengyuan, SUN Jiaze

School of Computer Science and Technology, Xi'an University of Posts and Telecommunications, Xi'an Shaanxi 710061, China

Received:2017-06-12 Revised:2017-08-04 Online:2017-12-10 Published:2017-12-18
Supported by:
This work is partially supported by the Industrial Science and Technology Research Project of Shaanxi Province (2017GY-092), the Natural Science Foundation of Shaanxi Education Department (15JK1678).

摘要/Abstract

摘要： 针对回归测试过程中由于测试需求的变更导致测试用例规模不断扩大、测试成本不断增加的问题，提出一种基于变异分析的测试用例约简方法（RTM）。首先，以测试用例能否检测到指定变异体为依据，对测试用例进行划分并创建二进制数值形式的变异体事务集矩阵；然后，应用改进的关联挖掘算法获取测试用例间的关联关系；最后，根据这些关联关系有效约简测试用例。6个经典程序仿真实验结果表明，RTM能够使约简后的测试用例约简率达到37%，与传统贪心算法和启发式算法相比，测试用例约简率提高了6%，且在提高测试用例约简率的同时，保证了测试覆盖率，单个测试用例的测试覆盖率平均提高了11%。所提方法能够利用尽可能少的测试用例满足更多的测试需求，有效提高了测试效率，降低了测试成本。

关键词: 回归测试, 测试用例约简, 变异分析, 变异体, 关联挖掘

Abstract: The scale of test suites is constantly expanding and the cost of testing is increasing due to the change of test requirements in the process of regression testing. In order to solve the problems, a Reduction method of Test suites based on the analysis of Mutation (RTM) was proposed. Firstly, the test suites were classified and the transaction set matrix of mutants was created in binary numerical form according to whether the designated mutants could be detected or not by test suites. Then, the correlation relation between test suites was obtained by using the improved association mining algorithm. Finally, the test suites were effectively reduced according to these relations. The simulation experimental results of the six classical programs show that, the test suite reduction rate of the proposed RTM can reach 37%. Compared with the traditional greedy algorithm and heuristic algorithm, the proposed RTM improves the test suite reduction rate by 6%, and can guarantee the test coverage rate at the same time, even the test coverage rate of a single test suite increases by 11% on average. The proposed method can meet more test requirements by using fewer test suites, effectively improving test efficiency and reducing test cost.

Key words: regression testing, test suite reduction, analysis of mutation, mutant, association mining

中图分类号:

TP311.5

王曙燕, 陈朋媛, 孙家泽. 基于变异分析的测试用例约简方法[J]. 计算机应用, 2017, 37(12): 3592-3596.

WANG Shuyan, CHEN Pengyuan, SUN Jiaze. Reduction method of test suites based on mutation analysis[J]. Journal of Computer Applications, 2017, 37(12): 3592-3596.

参考文献

[1] 顾庆,唐宝,陈道蓄.一种面向测试需求部分覆盖的测试用例集约简技术[J].计算机学报,2011,34(5):879-888.(GU Q, TANG B, CHEN D X. A test suite reduction technique for partial coverage of test requirements[J]. Chinese Journal of Computers, 2011, 34(5):879-888.)
[2] 章晓芳,徐宝文,聂长海,等.一种基于测试需求约简的测试用例集优化方法[J].软件学报,2007,18(4):821-831.(ZHANG X F, XU B W, NIE C H, et al. An approach for optimizing test suite based on testing requirement reduction[J]. Journal of Software, 2007, 18(4):821-831.)
[3] 郭曦,张焕国.基于谓词抽象的测试用例约简生成方法[J].通信学报,2012,33(3):35-43.(GUO X, ZHANG H G. Approach for reduced test suite generation based on predicate abstraction[J]. Journal on Communications, 2012, 33(3):35-43.)
[4] 邢行,尚颖,赵瑞莲,等.面向多目标测试用例优先排序的蚁群算法信息素更新策略[J].计算机应用,2016,36(9):2497-2502.(XING X, SHANG Y, ZHAO R L, et al. Pheromone updating strategy of ant colony algorithm for multi-objective test case prioritization[J]. Journal of Computer Applications, 2016, 36(9):2497-2502.)
[5] 周冲波,楼俊钢,程龙.基于矩阵行列变换的测试用例约简算法[J].计算机应用研究,2013,30(3):779-782.(ZHOU C B, LOU J G, CHENG L. Test suites reduction based on matrix transformation[J]. Application Research of Computers, 2013, 30(3):779-782.)
[6] ZHANG C Q, GROCE A, ALIPOUR M A. Using test case reduction and prioritization to improve symbolic execution[C]//ISSTA 2014:Proceedings of the 2014 International Symposium on Software Testing and Analysis. New York:ACM, 2014:160-170
[7] LIEMANDT J A, SUBRAMANIAM R, ABOEL-NIL S. Test case reduction for code regression testing:US, WO/2014/145604[P]. 2014-09-18.
[8] GRAVES T L, HARROLD M J, KIM J M, et al. An empirical study of regression test selection techniques[J]. ACM Transactions on Software Engineering and Methodology, 2001, 10(2):184-208.
[9] ASOUDEH N, LABICHE Y. A multi-objective genetic algorithm for gene-rating test suites from extended finite state machines[C]//Proceedings of the 2013 International Symposium on Search Based Software Engineering, LNCS 8084. Berlin:Springer, 2013:288-293.
[10] 华丽,王成勇,谷琼,等.基于遗传蚁群算法的测试用例集约简[J].工程数学学报,2012,29(4):486-492.(HUA L, WANG C Y, GU Q, et al. Test-suite reduction based on genetic algorithm and ant colony algorithm[J]. Chinese Journal of Engineering Mathematics, 2012, 29(4):486-492.)
[11] 聂长海,徐宝文.一种最小测试用例集生成方法[J].计算机学报,2003,26(12):1690-1695.(NIE C H, XU B W. A minimal test suite generation method[J]. Chinese Journal of Computers, 2003, 26(12):1690-1695.)
[12] 陈静,杨美红,王鲁,等.基于关联模式的回归测试用例约简模型[J].计算机工程,2011,37(2):63-65.(CHEN J, YANG M H, WANG L, et al. Regression test case reduction model based on association mode[J]. Computer Engineering, 2011, 37(2):63-65)
[13] 刘锋,李朋,朱二周.基于向量相似度的测试用例集约简方法[J].微电子学与计算机,2017,34(3):35-39.(LIU F, LI P, ZHU E Z. Test case reduction method based on vector similarity algorithm[J]. Microelectronics & Computer, 2017, 34(3):35-39.)
[14] 陈翔,顾庆.变异测试:原理、优化和应用[J].计算机科学与探索,2012,6(12):1057-1075.(CHEN X, GU Q. Mutation testing:principal, optimization and application[J]. Journal of Frontiers of Computer Science and Technology, 2012, 6(12):1057-1075.)
[15] DAOUDAGH S, LONETTI F, MARCHETTI E. Assessment of access control systems using mutation testing[C]//TELERISE 2015:Proceedings of the 2015 IEEE/ACM 1st International Workshop on TEchnical and LEgal aspects of data pRIvacy and SEcurity. Piscataway, NJ:IEEE, 2015:8-13..
[16] PAPADAKIS M, JIA Y, HARMAN M, et al. Trivial compiler equivalence:a large scale empirical study of a simple, fast and effective equivalent mutant detection technique[C]//Proceedings of the 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering. Piscataway, NJ:IEEE, 2015:936-946.
[17] KHAN R, AMJAD M. Optimize the software testing efficiency using genetic algorithm and mutation analysis[C]//Proceedings of the 20163rd International Conference on Computing for Sustainable Global Development. Piscataway, NJ:IEEE, 2016:1174-1176.
[18] 游亮,卢炎生.测试用例集启发式约简算法分析与评价[J].计算机科学,2011,38(12):147-150.(YOU L, LU Y S. Analysis and evaluation of heuristic algorithms for test suite reduction[J]. Computer Science, 2011, 38(12):147-150.)
[19] 张妍,傅秀芬.基于多优化目标的软件测试用例约简方法研究[J].计算机应用研究,2016,33(4):1111-1113.(ZHANG Y, FU X F. Software test case reduction method based on multi-objective optimization[J]. Application Research of Computers, 2016, 33(4):1111-1113.)

基于变异分析的测试用例约简方法

Reduction method of test suites based on mutation analysis

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 8

编辑推荐

Metrics

[1]	王曙燕, 袁佳娟, 孙家泽. 基于弱变异准则的测试用例约简方法[J]. 计算机应用, 2019, 39(2): 534-539.
[2]	王曙燕, 温春琰, 孙家泽. 基于自适应粒子群优化算法的测试数据扩增方法[J]. 计算机应用, 2016, 36(9): 2492-2496.
[3]	邢行, 尚颖, 赵瑞莲, 李征. 面向多目标测试用例优先排序的蚁群算法信息素更新策略[J]. 计算机应用, 2016, 36(9): 2497-2502.
[4]	曾凡平黄玉涵张美超潘能刚. 基于遗传算法聚类的变异体约简[J]. 计算机应用, 2011, 31(05): 1314-1317.
[5]	杜章华李建华胡江明程晓菊. 基于方法切片及入口依赖的回归测试研究[J]. 计算机应用, 2010, 30(06): 1651-1654.
[6]	陈树峰郑洪源. 面向对象软件的依赖性分析与回归测试[J]. 计算机应用, 2009, 29(11): 3110-3113.
[7]	陆永忠宋骏礼古希谦. 基于行为的软件测试过程模型及其应用研究[J]. 计算机应用, 2007, 27(5): 1238-1240.
[8]	尤永康，刘乃琦. 自动化回归测试在Java项目中的实现[J]. 计算机应用, 2005, 25(01): 88-90.