基于改进向量空间模型的克隆群映射方法

doi:10.11772/j.issn.1001-9081.2016.07.2031

计算机应用 ›› 2016, Vol. 36 ›› Issue (7): 2031-2037.DOI: 10.11772/j.issn.1001-9081.2016.07.2031

基于改进向量空间模型的克隆群映射方法

陈桌, 张丽萍, 王欢, 张久杰, 王春晖

内蒙古师范大学计算机与信息工程学院, 呼和浩特 010022

收稿日期:2015-12-28 修回日期:2016-03-11 出版日期:2016-07-10 发布日期:2016-07-14
通讯作者: 张丽萍
作者简介:陈桌(1989-),男,山东菏泽人,硕士研究生,主要研究方向:软件工程、软件分析;张丽萍(1974-),女,内蒙古呼和浩特人,教授,CCF会员,硕士,主要研究方向:软件工程、软件分析;王欢(1991-),男,内蒙古巴彦淖尔人,硕士研究生,主要研究方向:软件工程、软件分析;张久杰(1990-),男,内蒙古赤峰人,硕士研究生,主要研究方向:软件分析;王春晖(1979-),女(蒙古族),内蒙古通辽人,讲师,硕士,CCF会员,主要研究方向:软件分析、多媒体、计算机辅助教学。
基金资助:
国家自然科学基金资助项目（61363017，61462071）；内蒙古自然科学基金资助项目（2014MS0613）；内蒙古教育厅资助项目（NJZY14039）。

Clone group mapping method based on improved vector space model

CHEN Zhuo, ZHANG Liping, WANG Huan, ZHANG Jiujie, WANG Chunhui

College of Computer and Information Engineering, Inner Mongolia Normal University, Hohhot Nei Mongol 010022, China

Received:2015-12-28 Revised:2016-03-11 Online:2016-07-10 Published:2016-07-14
Supported by:
This work is partially supported by the National Natural Science Foundation of China (61363017, 61462071), the Natural Science Foundation of Inner Mongolia, China (2014MS0613), the Foundation Projects of Inner Mongolia Education Department (NJZY14039).

摘要/Abstract

摘要： 针对Type-3克隆代码映射方法少且效率低等问题，提出了一种基于改进向量空间模型（VSM）的映射方法。该方法将改进的VSM引入到克隆代码分析中，从而得到一种可有效映射Type-1、Type-2以及Type-3克隆代码的克隆群映射方法。首先，将克隆群文档预处理得到去除无用词的代码文档，同时提取克隆群文档的文件名、函数名等特征项；其次，提取并构建克隆群词频向量空间，利用余弦算法计算出克隆群相似度；然后，通过克隆群相似度和特征项的匹配构建克隆群映射，最终得到克隆群映射结果。对5款开源软件进行实验并人工验证，所提方法能在低时耗的前提下，保证查全率和查准率均不低于96.1%和97.1%。实验结果表明了所提方法的可行性，为后期软件演化分析提供数据支撑。

关键词: 克隆代码, 克隆群映射, 向量空间模型, 特征项, 词频

Abstract: Focusing on the less quantity and low efficiency problem of Type-3 clone code mapping method, a mapping method based on improved Vector Space Model (VSM) was proposed. Improved VSM was introduced into the clone code analysis to get an effective clone group mapping method for Type-1, Type-2 and Type-3. Firstly, clone group document was pretreated to get the code document with removing useless word, and the file name, function name and other features of clone group document were extracted at the same time. Secondly, word frequency vector space of clone group was extracted and built; the similarity of clone group was calculated by using cosine algorithm. Then mapping of clone group was constructed by clone group similarity and feature matching, and the result of cloning group mapping was obtained finally. Five pieces of open source software was tested and verified by experiments. The proposed method can guarantee the recall and the precision of not less than 96.1% and 97.1% at low time consumption. The experimental results show that the proposed method is feasible, which provides data support for the analysis of software evolution.

Key words: code clone, clone group mapping, Vector Space Model (VSM), feature item, word frequency

中图分类号:

TP311.5

陈桌, 张丽萍, 王欢, 张久杰, 王春晖. 基于改进向量空间模型的克隆群映射方法[J]. 计算机应用, 2016, 36(7): 2031-2037.

CHEN Zhuo, ZHANG Liping, WANG Huan, ZHANG Jiujie, WANG Chunhui. Clone group mapping method based on improved vector space model[J]. Journal of Computer Applications, 2016, 36(7): 2031-2037.

参考文献

[1] NGUYEN H A, NGUYEN T T, PHAM N H, et al. Clone management for evolving software[J]. IEEE Transactions on Software Engineering, 2012, 38(5):1008-1026.
[2] ZIBRAN M F, ROY C K. The road to software clone management:a survey[R]. Saskatoon, SK:The University of Saskatchewan, 2012:1-66.
[3] ROY C K, ZIBRAN M F, KOSCHKE R. The vision of software clone management:past, present, and future[C]//Proceedings of the 2014 IEEE Conference on Software Maintenance, Reengineering & Reverse Engineering. Piscataway, NJ:IEEE, 2014:18-33.
[4] SIDOROV G, GELBUKH A, GóMEZ-ADORNO H, et al. Soft similarity and soft cosine measure:similarity of features in vector space model[J]. Computación Y Sistemas, 2014, 18(3):491-504.
[5] BETTENBURG N, SHANG W, IBRAHIM W, et al. An empirical study on inconsistent changes to code clones at release level[J]. Science of Computer Programming, 2009, 77(6):85-94.
[6] 史庆庆,孟繁军,张丽萍,等.克隆代码技术研究综述[J].计算机应用研究,2013,30(6):1617-1623.(SHI Q Q, MENG F J, ZHANG L P, et al. Survey of research on code clone technique[J]. Application Research of Computers, 2013, 30(6):1617-1623.)
[7] THUMMALAPENTA S, CERULO L, AVERSANO L, et al. An empirical study on the maintenance of source code clones[J]. Empirical Software Engineering, 2010, 15(1):1-34.
[8] DUALA-EKOKO E, ROBILLARD M P. Tracking code clones in evolving software[C]//Proceedings of the 2007 International Conference on Software Engineering. Washington, DC:IEEE Computer Society, 2007:158-167.
[9] CANFORA G, CERULO L, PENTA M D. Identifying changed source code lines from version repositories[C]//Proceedings of the Fourth International Workshop on Mining Software Repositories. Washington, DC:IEEE Computer Society, 2007:14-14.
[10] DUALA-EKOKO E, ROBILLARD M P. Clone region descriptors:Representing and tracking duplication in source code[J]. ACM Transactions on Software Engineering and Methodology, 2010, 20(1):483-496.
[11] GÖDE N, KOSCHKE R. Incremental clone detection[C]//Proceedings of the 13th European Conference on Software Maintenance and Reengineering. Piscataway, NJ:IEEE, 2009:219-228.
[12] KAMIYA T, KUSUMOTO S, INOUE K. CCFinder:a multilinguistic token-based code clone detection system for large scale source code[J]. IEEE Transactions on Software Engineering, 2002, 28(7):654-670.
[13] 张瑞霞,张丽萍,王春晖,等.基于主题建模技术的克隆群映射方法[J].计算机工程与设计,2015,36(6):1524-1529.(ZHANG R X, ZHANG L P, WANG C H, et al. Clone group mapping method based on topic modeling[J]. Computer Engineering and Design, 2015, 36(6):1524-1529.)
[14] 涂颖,张丽萍,刘东升,等.基于软件多版本演化提取克隆谱系[J].计算机应用,2015,35(4):1169-1173.(TU Y, ZHANG L P, LIU D S, et al. Clone genealogies extraction base on software evolution over multiple versions[J]. Journal of Computer Applications, 2015, 35(4):1169-1173.)
[15] SALTON G, WONG A, YANG C S. A vector space model for automatic indexing[J]. Communications of the ACM, 1975, 18(11):613-620.
[16] 张久杰,王春晖,刘东升,等.基于Token编辑距离检测克隆代码[J].计算机应用,2015,35(12):3536-3543.(ZHANG J J, WANG C H, LIU D S, et al. Code clone detection based on Levenshtein distance of token[J]. Journal of Computer Applications, 2015, 35(12):3536-3543.)

基于改进向量空间模型的克隆群映射方法

Clone group mapping method based on improved vector space model

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	李勇, 相中启. 基于计数型布隆过滤器的可排序密文检索方法[J]. 计算机应用, 2018, 38(9): 2554-2559.
[2]	折蓉蓉, 张丽萍, 侯敏, 闫盛. 基于决策树推荐克隆重构的方法[J]. 计算机应用, 2018, 38(7): 2037-2043.
[3]	杨宏宇, 王玥. 云存储环境下的多关键字密文搜索方法[J]. 计算机应用, 2018, 38(2): 343-347.
[4]	章宁, 陈钦. 基于TF-IDF算法的P2P贷款违约预测模型[J]. 计算机应用, 2018, 38(10): 3042-3047.
[5]	吴峰, 王颖. 基于改进信息增益的人体动作识别视觉词典建立[J]. 计算机应用, 2017, 37(8): 2240-2243.
[6]	王欢, 张丽萍, 闫盛, 刘东升. 克隆代码有害性预测中的特征选择模型[J]. 计算机应用, 2017, 37(4): 1135-1142.
[7]	张久杰, 翟晔, 王春晖, 张丽萍, 刘东升. 基于版本间克隆映射的演化模式识别及谱系构建[J]. 计算机应用, 2016, 36(7): 2021-2030.
[8]	黄伟, 林劼, 江育娥. 云环境下软件错误报告自动分类算法改进[J]. 计算机应用, 2016, 36(5): 1212-1215.
[9]	罗燕, 赵书良, 李晓超, 韩玉辉, 丁亚飞. 基于词频统计的文本关键词提取方法[J]. 计算机应用, 2016, 36(3): 718-725.
[10]	陈桌, 张丽萍, 王春晖. 基于软件代码演化信息的克隆谱系提取方法[J]. 计算机应用, 2016, 36(12): 3461-3467.
[11]	王欢, 张丽萍, 闫盛. 克隆代码有害性预测中分类不平衡问题的解决方法[J]. 计算机应用, 2016, 36(12): 3468-3475.
[12]	程玉胜, 梁辉, 王一宾, 黎康. 基于风险决策的文本语义分类算法[J]. 计算机应用, 2016, 36(11): 2963-2968.
[13]	张丽萍, 张瑞霞, 王欢, 闫盛. 基于贝叶斯网络的克隆代码有害性预测[J]. 计算机应用, 2016, 36(1): 260-265.
[14]	胡杨, 戴丹, 刘骊, 冯旭鹏, 刘利军, 黄青松. 基于情感角色模型的文本情感分类方法[J]. 计算机应用, 2015, 35(5): 1310-1313.
[15]	涂颖, 张丽萍, 王春晖, 侯敏, 刘东升. 基于软件多版本演化提取克隆谱系[J]. 计算机应用, 2015, 35(4): 1169-1173.