改进的基于层次距离的基因表达式编程特征选择分类算法

doi:10.11772/j.issn.1001-9081.2020111801

计算机应用 ›› 2021, Vol. 41 ›› Issue (9): 2658-2667.DOI: 10.11772/j.issn.1001-9081.2020111801

所属专题：先进计算

改进的基于层次距离的基因表达式编程特征选择分类算法

湛航¹, 何朗¹, 黄樟灿¹, 李华峰¹, 张蔷¹, 谈庆²

1. 武汉理工大学理学院, 武汉 430070;
2. 武汉大学数学与统计学院, 武汉 430072

收稿日期:2020-11-17 修回日期:2021-03-09 出版日期:2021-09-10 发布日期:2021-09-15
通讯作者: 何朗
作者简介:湛航(1996-),男,湖北孝感人,硕士研究生,主要研究方向:智能计算;何朗(1974-),男,湖北鄂州人,教授,博士,主要研究方向:演化计算、智能计算;黄樟灿(1960-),男,浙江嵊州人,教授,博士,主要研究方向:智能计算、图像处理;李华峰(1995-),男,山西临汾人,硕士研究生,主要研究方向:智能计算;张蔷(1996-),女,河南信阳人,硕士研究生,主要研究方向:智能计算;谈庆(1991-),男,湖南长沙人,博士研究生,主要研究方向:智能计算、图像处理。
基金资助:
国家自然科学基金面上项目（61672391）。

Improved feature selection and classification algorithm for gene expression programming based on layer distance

ZHAN Hang¹, HE Lang¹, HUANG Zhangcan¹, LI Huafeng¹, ZHANG Qiang¹, TAN Qing²

1. School of Science, Wuhan University of Technology, Wuhan Hubei 430070, China;
2. School of Mathematics and Statistics, Wuhan University, Wuhan Hubei 430072, China

Received:2020-11-17 Revised:2021-03-09 Online:2021-09-10 Published:2021-09-15
Supported by:
This work is partially supported by the Surface Program of National Natural Science Foundation of China (61672391).

摘要/Abstract

摘要： 针对一般特征选择算法未能揭示数据特征与数据类别之间的可解释性映射关系的问题，在基因表达式编程（GEP）的基础上，通过引入初始化方法、变异策略以及适应度评价方法，提出了一种改进的基于层次距离的GEP特征选择分类算法（FSLDGEP）。首先，利用定义的选择概率有导向地初始化种群个体，从而增加种群中有效个体的数量；其次，定义个体的层次邻域，使种群个体基于其层次邻域进行变异，并解决了变异过程中的盲目无导向性问题；最后，将维度缩减率与分类准确率结合起来作为个体的适应度值，从而改变种群单一优化目标的进化模式，并平衡两者之间的关系。在7个数据集上进行5折交叉和10折交叉验证，所提算法给出了数据特征及其类别之间的函数映射关系，将得到的映射函数用于数据分类。与森林优化特征选择算法（FSFOA）、邻域软边界特征选择算法（NSM）、基于邻域有效信息比的特征选择算法（FS-NEIR）等对比算法相比，所提算法的维度缩减率在Hepatitis、WPBC（Wisconsin Prognostic Breast Cancer）、Sonar、WDBC（Wisconsin Diagnostic Breast Cancer）数据集上得到了最好结果；与对比算法相比，所提算法的平均分类准确率在Hepatitis、Ionosphere、Musk1、WPBC、Heart-Statlog、WDBC数据集上得到了最好结果。实验结果验证了所提算法在特征选择分类问题上的可行性、有效性和优越性。

关键词: 特征选择, 函数发现, 基因表达式编程, 种群初始化, 层次邻域

Abstract: Concerning the problem that the interpretable mapping relationship between data features and data categories do not be revealed by general feature selection algorithms. on the basis of Gene Expression Programming (GEP),by introducing the initialization methods, mutation strategies and fitness evaluation methods,an improved Feature Selection classification algorithm based on Layer Distance for GEP(FSLDGEP) was proposed. Firstly,the selection probability was defined to initialize the individuals in the population directionally, so as to increase the number of effective individuals in the population. Secondly, the layer neighborhood of the individual was proposed, so that each individual in the population would mutate based on its layer neighborhood, and the blind and unguided problem in the process of mutation was solved。Finally, the dimension reduction rate and classification accuracy were combined as the fitness value of the individual, which changed the population evolutionary mode of single optimization goal and balanced the relationship between the above two. The 5-fold and 10-fold verifications were performed on 7 datasets, the functional mapping relationship between data features and their categories was given by the proposed algorithm, and the obtained mapping function was used for data classification. Compared with Feature Selection based on Forest Optimization Algorithm (FSFOA), feature evaluation and selection based on Neighborhood Soft Margin (NSM), Feature Selection based on Neighborhood Effective Information Ratio (FS-NEIR)and other comparison algorithms, the proposed algorithm has obtained the best results of the dimension reduction rate on Hepatitis, Wisconsin Prognostic Breast Cancer (WPBC), Sonar and Wisconsin Diagnostic Breast Cancer (WDBC) datasets, and has the best average classification accuracy on Hepatitis, Ionosphere, Musk1, WPBC, Heart-Statlog and WDBC datasets. Experimental results shows that the feasibility, effectiveness and superiority of the proposed algorithm in feature selection and classification are verified.

Key words: feature selection, function discovery, Gene Expression Programming (GEP), population initialization, layer neighborhood

中图分类号:

TP317.4

湛航, 何朗, 黄樟灿, 李华峰, 张蔷, 谈庆. 改进的基于层次距离的基因表达式编程特征选择分类算法[J]. 计算机应用, 2021, 41(9): 2658-2667.

ZHAN Hang, HE Lang, HUANG Zhangcan, LI Huafeng, ZHANG Qiang, TAN Qing. Improved feature selection and classification algorithm for gene expression programming based on layer distance[J]. Journal of Computer Applications, 2021, 41(9): 2658-2667.

参考文献

[1] 张翠军, 陈贝贝, 周冲, 等. 基于多目标骨架粒子群优化的特征选择算法[J]. 计算机应用,2018,38(11):3156-3160,3166. (ZHANG C J,CHEN B B,ZHOU C,et al. Feature selection algorithm based on multi-objective bare-bones particle swarm optimization[J]. Journal of Computer Applications, 2018, 38(11):3156-3160,3166.)
[2] 谢琪, 徐旭, 程耕国, 等. 基于新的森林优化算法的特征选择算法[J]. 计算机应用,2020,40(5):1266-1271.(XIE Q,XU X, CHENG G G,et al. Feature selection algorithm based on new forest optimization algorithm[J]. Journal of Computer Applications, 2020,40(5):1266-1271.)
[3] 谢娟英, 王明钊, 周颖, 等. 非平衡基因数据的差异表达基因选择算法研究[J]. 计算机学报,2019,42(6):1232-1251.(XE J Y, WANG M Z,ZHOU Y,et al. Differential expression gene selection algorithms for unbalanced gene datasets[J]. Chinese Journal of Computers,2019,42(6):1232-1251.)
[4] 王翔, 胡学钢. 高维小样本分类问题中特征选择研究综述[J]. 计算机应用,2017,37(9):2433-2438,2448.(WANG X,HU X G. Overview on feature selection in high-dimensional and smallsample-size classification[J]. Journal of Computer Applications, 2017,37(9):2433-2438,2448.)
[5] 樊鑫, 陈红梅. 基于差别矩阵和mRMR的分步优化特征选择算法[J]. 计算机科学,2020,47(1):87-95.(FAN X,CHEN H M. Stepwise optimized feature selection algorithm based on discernibility matrix and mRMR[J]. Computer Science,2020,47(1):87-95.)
[6] 姚登举. 面向医学数据的随机森林特征选择及分类方法研究[D]. 哈尔滨:哈尔滨工程大学,2016:1-2.(YAO D J. Research on feature selection and classification method based on random forest for medical datasets[D]. Harbin:Harbin Engineering University,2016:1-2.)
[7] 李占山, 刘兆赓. 基于XGBoost的特征选择算法[J]. 通信学报, 2019,40(10):101-108.(LI Z S,LIU Z G. Feature selection algorithm based on XGBoost[J]. Journal on Communications, 2019,40(10):101-108.)
[8] CHANDRASHEKAR G,SAHIN F. A survey on feature selection methods[J]. Computers and Electrical Engineering,2014,40(1):16-28.
[9] SHARMIN S,SHOYAIB M,ALI A A,et al. Simultaneous feature selection and discretization based on mutual information[J]. Pattern Recognition,2019,91:162-174.
[10] 谢娟英, 谢维信. 基于特征子集区分度与支持向量机的特征选择算法[J]. 计算机学报,2014,37(8):1704-1718.(XIE J Y, XIE W X. Several feature selection algorithms based on the discernibility of a feature subset and support vector machines[J]. Chinese Journal of Computers,2014,37(8):1704-1718.)
[11] 张鑫. 基于自然进化策略的特征选择算法研究[D]. 长春:吉林大学,2020:1-2. (ZHANG X. Research of feature selection algorithm based on natural evolution strategy[D]. Changchun:Jilin University,2020:1-2.)
[12] 李航. 统计学习方法[M]. 北京:清华大学出版社,2012:72-75.(LI H. Statistical Learning Methods[M]. Beijing:Tsinghua University Press,2012:72-75.)
[13] MOUSTAKIDIS S P,THEOCHARIS J B. SVM-FuzCoC:a novel SVM-based feature selection method using a fuzzy complementary criterion[J]. Pattern Recognition,2010,43(11):3712-3729.
[14] SUN Z Q,ZHANG J,DAI L,et al. Mutual information based multi-label feature selection via constrained convex optimization[J]. Neurocomputing,2019,329:447-456.
[15] SHEIKHI G,ALTINÇAY H. maximum-relevance and maximumdiversity of positive ranks:a novel feature selection method[J]. Expert Systems with Applications,2020,158:No. 113499.
[16] GHAEMI M,FEIZI-DERAKHSHI M R. Feature selection using forest optimization algorithm[J]. Pattern Recognition,2016,60:121-129.
[17] 张梦林, 李占山. 基于SAC的特征选择算法[J]. 计算机科学, 2018,45(2):63-68.(ZHANG M L,LI Z S. Feature selection algorithm using SAC algorithm[J]. Computer Science,2018,45(2):63-68.)
[18] 李光华, 李俊清, 张亮, 等. 一种融合蚁群算法和随机森林的特征选择方法[J]. 计算机科学,2019,46(11A):212-215.(LI G H,LI J Q,ZHANG L,et al. Feature selection method based on ant colony optimization and random forest[J]. Computer Science, 2019,46(11A):212-215.)
[19] TABAKHI S,MORADI P,AKHLAGHIAN F. An unsupervised feature selection algorithm based on ant colony optimization[J]. Engineering Applications of Artificial Intelligence,2014,32:112-123.
[20] MA J B,GAO X Y. Designing genetic programming classifiers with feature selection and feature construction[J]. Applied Soft Computing,2020,97(Pt B):No. 106826.
[21] MA J B,GAO X Y. A filter-based feature construction and feature selection approach for classification using Genetic Programming[J]. Knowledge-Based Systems,2020,196:No. 105806.
[22] FERREIRA C. Gene expression programming:a new adaptive algorithm for solving problems[J]. Complex Systems,2001,13(2):87-129.
[23] 崔未. 基于层次距离的GEP算法及其应用[D]. 武汉:武汉理工大学,2019:17-28.(CUI W. Application of gene expression programming based on layer distance[D]. Wuhan:Wuhan University of Technology,2019:17-28.)
[24] DUA D,GRAFF C. UCI machine learning repository[DS/OL].[2020-11-11]. http://archive.ics.uci.edu/ml.
[25] ZHU W Z,SI G Q,ZHANG Y B,et al. Neighborhood effective information ratio for hybrid feature subset evaluation and selection[J]. Neurocomputing,2013,99:25-37.
[26] HU Q H,CHE X J,ZHANG L,et al. Feature evaluation and selection based on neighborhood soft margin[J]. Neurocomputing, 2010,73(10/11/12):2114-2124.
[27] XUE B, ZHANG M J, BROWNE W N. Particle swarm optimisation for feature selection in classification:novel initialisation and updating mechanisms[J]. Applied Soft Computing,2014,18:261-276.
[28] HUANG J J,CAI Y Z,XU X M. A hybrid genetic algorithm for feature selection wrapper based on mutual information[J]. Pattern Recognition Letters,2007,28(13):1825-1844.
[29] ZHOU H F,WEN J. Dynamic feature selection method with minimum redundancy information for linear data[J]. Applied Intelligence,2020,50(11):3660-3677.
[30] GAO W F,HU L,ZHANG P. Class-specific mutual information variation for feature selection[J]. Pattern Recognition,2018,79:328-339.
[31] HU Q H,ZHANG L,CHEN D G,et al. Gaussian kernel based fuzzy rough sets:model,uncertainty measures and applications[J]. International Journal of Approximate Reasoning,2010,51(4):453-471.
[32] HU Q H,YU D R,LIU J F,et al. Neighborhood rough set based heterogeneous feature subset selection[J]. Information Sciences, 2008,178(18):3577-3594.
[33] HU Q H,PEDRYCZ W,YU D R,et al. Selecting discrete and continuous features based on neighborhood decision error minimization[J]. IEEE Transactions on Systems, Man, and Cybernetics,Part B(Cybernetics),2010,40(1):137-150.
[34] 王颖, 曹捷, 邱志洋. 基于乌鸦搜索算法的新型特征选择算法[J]. 吉林大学学报(理学版),2019,57(4):869-874.(WANG Y,CAO J,QIU Z Y. A novel feature selection algorithm based on crow search algorithm[J]. Journal of Jilin University (Science Edition),2019,57(4):869-874.)
[35] 邓秀勤, 李文洲, 武继刚, 等. 融合Shapley值和粒子群优化算法的混合特征选择算法[J]. 计算机应用,2018,38(5):1245-1249.(DENG X Q,LI W Z,WU J G,et al. Hybrid feature selection algorithm fused Shapley value and particle swarm optimization[J]. Journal of Computer Applications,2018,38(5):1245-1249.)
[36] SASIKALA S,APPAVU ALIAS BALAMURUGAN S,GEETHA S. A novel adaptive feature selector for supervised classification[J]. Information Processing Letters,2016,117:25-34.

改进的基于层次距离的基因表达式编程特征选择分类算法

Improved feature selection and classification algorithm for gene expression programming based on layer distance

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	祝承, 赵晓琦, 赵丽萍, 焦玉宏, 朱亚飞, 陈建英, 周伟, 谭颖. 基于谱聚类半监督特征选择的功能磁共振成像数据分类[J]. 计算机应用, 2021, 41(8): 2288-2293.
[2]	李蒙蒙, 秦伟, 刘艺, 刁兴春. 结合头脑风暴优化的混合蚁群优化算法[J]. 计算机应用, 2021, 41(8): 2412-2417.
[3]	贾鹤鸣, 姜子超, 李瑶, 孙康健. 基于改进斑点鬣狗优化算法的同步优化特征选择[J]. 计算机应用, 2021, 41(5): 1290-1298.
[4]	林筠超, 万源. 基于图结构优化的自适应多度量非监督特征选择方法[J]. 计算机应用, 2021, 41(5): 1282-1289.
[5]	张志浩, 林耀进, 卢舜, 郭晨, 王晨曦. 缺失标记下基于类属属性的多标记特征选择[J]. 计算机应用, 2021, 41(10): 2849-2857.
[6]	顾桐, 许国良, 李万林, 李家浩, 王志愿, 雒江涛. 基于集成LightGBM和贝叶斯优化策略的房价智能评估模型[J]. 计算机应用, 2020, 40(9): 2762-2767.
[7]	黄学雨, 徐浩特, 陶剑文. 具有特征选择的多源自适应分类框架[J]. 计算机应用, 2020, 40(9): 2499-2506.
[8]	肖跃雷, 张云娇. 基于特征选择和超参数优化的恐怖袭击组织预测方法[J]. 计算机应用, 2020, 40(8): 2262-2267.
[9]	刘丹, 姚立霜, 王云锋, 裴作飞. 面向类不平衡流量数据的分类模型[J]. 计算机应用, 2020, 40(8): 2327-2333.
[10]	汪志远, 降爱莲, 奥斯曼·穆罕默德. 基于正则互表示的无监督特征选择方法[J]. 计算机应用, 2020, 40(7): 1896-1900.
[11]	谢琪, 徐旭, 程耕国, 陈和平. 基于新的森林优化算法的特征选择算法[J]. 计算机应用, 2020, 40(5): 1266-1271.
[12]	曹堉, 王成, 王鑫, 高悦尔. 基于时空节点选择和深度学习的城市道路短时交通流预测[J]. 计算机应用, 2020, 40(5): 1488-1493.
[13]	曾元鹏, 王开军, 林崧. 面向二类区分能力的干扰熵特征选择方法[J]. 计算机应用, 2020, 40(3): 626-630.
[14]	章夏杰, 朱敬华, 陈杨. Spark下的分布式粗糙集属性约简算法[J]. 计算机应用, 2020, 40(2): 518-523.
[15]	程玉胜, 宋帆, 王一宾, 钱坤. 基于专家特征的条件互信息多标记特征选择算法[J]. 计算机应用, 2020, 40(2): 503-509.