Multi-label feature selection based on label-specific feature with missing labels

doi:10.11772/j.issn.1001-9081.2020111893

Journal of Computer Applications ›› 2021, Vol. 41 ›› Issue (10): 2849-2857.DOI: 10.11772/j.issn.1001-9081.2020111893

Special Issue: 人工智能

• Artificial intelligence • Previous Articles Next Articles

Multi-label feature selection based on label-specific feature with missing labels

ZHANG Zhihao^1,2, LIN Yaojin^1,2, LU Shun^1,2, GUO Chen^1,2, WANG Chenxi^1,2

1. School of Computer Science, Minnan Normal University, Zhangzhou Fujian 363000, China;
2. Key Laboratory of Data Science and Intelligence Application of Fujian Provincial Universities(Minnan Normal University), Zhangzhou Fujian 363000, China

Received:2020-12-03 Revised:2021-03-01 Online:2021-10-10 Published:2021-10-27
Supported by:
This work is partially supported by the Surface Program of National Natural Science Foundation of China (62076116), the Surface Program of Natural Science Foundation of Fujian Province (2020J01811).

缺失标记下基于类属属性的多标记特征选择

张志浩^1,2, 林耀进^1,2, 卢舜^1,2, 郭晨^1,2, 王晨曦^1,2

1. 闽南师范大学计算机学院, 福建漳州 363000;
2. 数据科学与智能应用福建省高校重点实验室(闽南师范大学), 福建漳州 363000

通讯作者: 林耀进
作者简介:张志浩(1996-),男,福建龙岩人,硕士研究生,主要研究方向:数据挖掘;林耀进(1980-),男,福建漳州人,教授,博士,主要研究方向:数据挖掘、机器学习;卢舜(1996-),男,福建三明人,硕士研究生,主要研究方向:数据挖掘;郭晨(1996-),男,福建莆田人,硕士研究生,主要研究方向:数据挖掘;王晨曦(1981-),女,辽宁凤城人,副教授,硕士,主要研究方向:数据挖掘、机器学习。
基金资助:
国家自然科学基金面上项目（62076116）；福建省自然科学基金面上项目（2020J01811）。

Abstract

Abstract: Multi-label feature selection has been widely used in many domains, such as image classification and disease diagnosis. However, there usually exist missing labels in the label space of data in practice, which destroys the structure and correlation between labels, so that the learning algorithms are difficult to exactly select important features. To address this problem, a Multi-label Feature Selection based on Label-specific feature with Missing Labels (MFSLML) algorithm was proposed. Firstly, the label-specific feature for each class label was obtained via sparse learning method. At the same time, the mapping relations between labels and label-specific features were constructed based on linear regression model, and were used to recover the missing labels. Finally, experiments were performed on 7 datasets with using 4 evaluation metrics. Experimental results show that compared to some state-of-the-art multi-label feature selection algorithms, such as multi-label feature selection algorithm based Max-Dependency and Min-Redundancy (MDMR) and the Multi-label Feature selection with Missing Labels via considering feature interaction (MFML), MFSLML can increase the average precision by 4.61-5.5 percentage points. It can be seen that MFSLML achieves better classification performance.

Key words: feature selection, label-specific feature, missing label, linear regression, multi-label learning

摘要： 多标记特征选择已在图像分类、疾病诊断等领域得到广泛应用；然而，现实中数据的标记空间往往存在部分标记缺失的问题，这破坏了标记间的结构性和关联性，使得学习算法难以准确地选择重要特征。针对此问题，提出一种缺失标记下基于类属属性的多标记特征选择（MFSLML）算法。首先，通过利用稀疏学习方法获取每个类标记的类属属性；同时基于线性回归模型构建类属属性与标记的映射关系，以用于恢复缺失标记；最后，选取7组数据集以及4个评价指标进行实验。实验结果表明：相比基于最大依赖度和最小冗余度的多标记特征选择算法（MDMR）和基于特征交互的多标记特征选择算法（MFML）等一些先进的多标记特征选择算法，MFSLML在平均查准率指标上能够提升4.61~5.5个百分点，由此可见MFSLML具有更优的分类性能。

关键词: 特征选择, 类属属性, 缺失标记, 线性回归, 多标记学习

CLC Number:

TP181

ZHANG Zhihao, LIN Yaojin, LU Shun, GUO Chen, WANG Chenxi. Multi-label feature selection based on label-specific feature with missing labels[J]. Journal of Computer Applications, 2021, 41(10): 2849-2857.

张志浩, 林耀进, 卢舜, 郭晨, 王晨曦. 缺失标记下基于类属属性的多标记特征选择[J]. 计算机应用, 2021, 41(10): 2849-2857.

References

[1] LIN Y J, HU Q H, LIU J H, et al. Streaming feature selection for multilabel learning based on fuzzy mutual information[J]. IEEE Transactions on Fuzzy Systems, 2017, 25(6):1491-1507.
[2] 王晨曦, 林耀进, 唐莉, 等. 基于信息粒化的多标记特征选择算法[J]. 模式识别与人工智能, 2018, 31(2):123-131.(WANG C X, LIN Y J, TANG L, et al. Multi-label feature selection based on information granulation[J]. Pattern Recognition and Artificial Intelligence, 2018, 31(2):123-131.)
[3] LIU J H, LI Y W, WENG W, et al. Feature selection for multilabel learning with streaming label[J]. Neurocomputing, 2020, 387:268-278.
[4] 徐淼, 周志华. 利用辅助信息进行矩阵补全的核方法及其在多标记学习中的应用[J]. 中国科学:信息科学, 2018, 48(1):47-59.(XU M, ZHOU Z H. Kernel method for matrix completion with side information and its application in multi-label learning[J]. SCIENTIA SINICA Informationis, 2018, 8(1):47-59.)
[5] ZHANG M L, ZHOU Z H. A review on multi-label learning algorithms[J]. IEEE Transactions on Knowledge and Data Engineering, 2014, 26(8):1819-1837.
[6] 胡敏杰, 林耀进, 王晨曦, 等. 基于拉普拉斯评分的多标记特征选择算法[J]. 计算机应用, 2018, 38(11):121-128.(HU M J, LIN Y J, WANG C X, et al. Multi-label feature selection algorithm based on Laplacian score[J]. Journal of Computer Applications, 2018, 38(11):3167-3174.)
[7] ZHANG J, LUO Z M, LI C D, et al. Manifold regularized discriminative feature selection for multi-label learning[J]. Pattern Recognition, 2019, 95:136-150.
[8] GHARROUDI O, ELGHAZEL H, AUSSEM A. A comparison of multi-label feature selection methods using the random forest paradigm[C]//Proceedings of the 2014 Canadian Conference on Artificial Intelligence, LNCS 8436. Cham:Springer, 2014:95-106.
[9] LIN Y J, HU Q H, LIU J H, et al. Multi-label feature selection based on max-dependency and min-redundancy[J]. Neurocomputing, 2015, 168:92-103.
[10] ZHANG M L, WU L. LIFT:multi-label learning with labelspecific features[J]. IEEE Transaction on Pattern Analysis and Machine Intelligence, 2015, 37(1):107-120.
[11] WANG C X, LIN Y J, LIU J H. Feature selection for multi-label learning with missing labels[J]. Applied Intelligence, 2019, 49(8):3027-3042.
[12] ZHU P F, XU Q, HU Q H, et al. Multi-label feature selection with missing labels[J]. Pattern Recognition, 2018, 74:488-502.
[13] WU B Y, LYU S W, GHANEM B. Constrained submodular minimization for missing labels and class imbalance in multi-label learning[C]//Proceedings of the 30th AAAI Conference on Artificial Intelligence. Palo Alto, CA:AAAI Press, 2016:2229-2236.
[14] BECK A, TEBOULLE M. A fast iterative shrinkage-thresholding algorithm for linear inverse problems[J]. SIAM Journal on Imaging Sciences, 2009, 2(1):183-202.
[15] ZHANG Y, ZHOU Z H. Multilabel dimensionality reduction via dependence maximization[J]. ACM Transactions on Knowledge Discovery from Data, 2010, 4(3):No. 14.
[16] LEE J, KIM D W. Feature selection for multi-label classification using multivariate mutual information[J]. Pattern Recognition Letters, 2013, 34(3):349-357.
[17] HUANG J, QIN F, ZHENG X, et al. Improving multi-label classification with missing labels by learning label-specific features[J]. Information Sciences, 2019, 492:124-146.
[18] ZHANG M L, ZHOU Z H. ML-KNN:a lazy learning approach to multi-label learning[J]. Pattern Recognition, 2007, 40(7):2038-2048.

Multi-label feature selection based on label-specific feature with missing labels

缺失标记下基于类属属性的多标记特征选择

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	ZHAN Hang, HE Lang, HUANG Zhangcan, LI Huafeng, ZHANG Qiang, TAN Qing. Improved feature selection and classification algorithm for gene expression programming based on layer distance [J]. Journal of Computer Applications, 2021, 41(9): 2658-2667.
[2]	ZHU Cheng, ZHAO Xiaoqi, ZHAO Liping, JIAO Yuhong, ZHU Yafei, CHENG Jianying, ZHOU Wei, TAN Ying. Classification of functional magnetic resonance imaging data based on semi-supervised feature selection by spectral clustering [J]. Journal of Computer Applications, 2021, 41(8): 2288-2293.
[3]	LI Mengmeng, QIN Wei, LIU Yi, DIAO Xingchun. Hybrid ant colony optimization algorithm with brain storm optimization [J]. Journal of Computer Applications, 2021, 41(8): 2412-2417.
[4]	JIA Heming, JIANG Zichao, LI Yao, SUN Kangjian. Simultaneous feature selection optimization based on improved spotted hyena optimizer algorithm [J]. Journal of Computer Applications, 2021, 41(5): 1290-1298.
[5]	LIN Junchao, WAN Yuan. Self-adaptive multi-measure unsupervised feature selection method with structured graph optimization [J]. Journal of Computer Applications, 2021, 41(5): 1282-1289.
[6]	LIN Tengtao, ZHA Siming, CHEN Lei, LONG Xianzhong. Graph trend filtering guided noise tolerant multi-label learning model [J]. Journal of Computer Applications, 2021, 41(1): 8-14.
[7]	GU Tong, XU Guoliang, LI Wanlin, LI Jiahao, WANG Zhiyuan, LUO Jiangtao. Intelligent house price evaluation model based on ensemble LightGBM and Bayesian optimization strategy [J]. Journal of Computer Applications, 2020, 40(9): 2762-2767.
[8]	HUANG Xueyu, XU Haote, TAO Jianwen. Multi-source adaptation classification framework with feature selection [J]. Journal of Computer Applications, 2020, 40(9): 2499-2506.
[9]	LIU Dan, YAO Lishuang, WANG Yunfeng, PEI Zuofei. Classification model for class imbalanced traffic data [J]. Journal of Computer Applications, 2020, 40(8): 2327-2333.
[10]	XIAO Yuelei, ZHANG Yunjiao. Terrorist attack organization prediction method based on feature selection and hyperparameter optimization [J]. Journal of Computer Applications, 2020, 40(8): 2262-2267.
[11]	WANG Zhiyuan, JIANG Ailian, MUHAMMAD Osman. Unsupervised feature selection method based on regularized mutual representation [J]. Journal of Computer Applications, 2020, 40(7): 1896-1900.
[12]	CAO Jianfang, ZHAO Aidi, ZHANG Zibang. Application of convolutional neural network with threshold optimization in image annotation [J]. Journal of Computer Applications, 2020, 40(6): 1587-1592.
[13]	CAO Yu, WANG Cheng, WANG Xin, GAO Yueer. Urban road short-term traffic flow prediction based on spatio-temporal node selection and deep learning [J]. Journal of Computer Applications, 2020, 40(5): 1488-1493.
[14]	XIE Qi, XU Xu, CHENG Gengguo, CHEN Heping. Feature selection algorithm based on new forest optimization algorithm [J]. Journal of Computer Applications, 2020, 40(5): 1266-1271.
[15]	ZENG Yuanpeng, WANG Kaijun, LIN Song. Interference entropy feature selection method for two-class distinguishing ability [J]. Journal of Computer Applications, 2020, 40(3): 626-630.