Multi-source adaptation classification framework with feature selection

doi:10.11772/j.issn.1001-9081.2020010094

Journal of Computer Applications ›› 2020, Vol. 40 ›› Issue (9): 2499-2506.DOI: 10.11772/j.issn.1001-9081.2020010094

• Artificial intelligence • Previous Articles Next Articles

Multi-source adaptation classification framework with feature selection

HUANG Xueyu¹, XU Haote¹, TAO Jianwen²

1. School of Information Engineering, Jiangxi University of Science and Technology, Ganzhou Jiangxi 341000, China;
2. School of Electronic Information Engineering, Ningbo Polytechnic, Ningbo Zhejiang 315100, China

Received:2020-02-04 Revised:2020-04-21 Online:2020-09-10 Published:2020-04-28
Supported by:
This work is partially supported by the Natural Science Foundation of Zhejiang Province (LY19F020012), the Key Research and Development Project of Ganzhou Science and Technology ([2018]50-8-3).

具有特征选择的多源自适应分类框架

黄学雨¹, 徐浩特¹, 陶剑文²

1. 江西理工大学信息工程学院, 江西赣州 341000;
2. 宁波职业技术学院电子信息工程学院, 浙江宁波 315100

通讯作者: 徐浩特
作者简介:黄学雨(1970-),男,江西赣州人,副教授,硕士,主要研究方向:视觉工程技术、企业信息系统;徐浩特(1995-),男,浙江温州人,硕士研究生,主要研究方向:机器学习、模式识别;陶剑文(1973-),男,湖北武汉人,教授,博士,主要研究方向:模式识别、机器学习。
基金资助:
浙江省自然科学基金资助项目（LY19F020012）；赣州科技重点研发项目（[2018]50-8-3）。

Abstract

Abstract: For the problem that the existing multi-source adaptation learning schemes cannot effectively distinguish the useful information in multi-source domains and transfer the information to the target domain, a Multi-source Adaptation Classification Framework with Feature Selection (MACFFS) was proposed. Feature selection and shared feature subspace learning were integrated into a unified framework by MACFFS for joint feature learning. Specifically, multiple source domain classification models were learned and obtained by MACFFS through mapping feature data from multiple source domains into different latent spaces, so as to realize the classification of target domains. Then, the obtained multiple classification results were integrated for the learning of the target domain classification model. In addition, L_2,1 norm sparse regression was used to replace the traditional least squares regression based on L₂ norm by the framework to improve the robustness. Finally, a variety of existing methods were used to perform experimental comparison and analysis with MACFFS in two tasks. Experimental results show that, compared with the best performing Domain Selection Machine (DSM) in the existing methods, MACFFS has nearly 1/4 of the calculation time saved, and the recognition rate of about 2% improved. In general, with machine learning, statistical learning and other related knowledge combined, MACFFS provides a new idea for the multi-source adaptation method. Furthermore, this method has better performance than the existing methods in recognition applications in real scenes, which had been experimentally proven.

Key words: multi-source adaptation, object recognition, shared feature subspace, feature selection, transfer learning

摘要： 对于现有的多源自适应学习方案无法有效区分多个源域中的有用信息并迁移至目标域的问题，提出一种具有特征选择的多源自适应分类框架（MACFFS），并将特征选择和共享特征子空间学习整合到统一框架中进行联合特征学习。具体来说，MACFFS将来自多个源域的特征数据投影至不同的潜在空间中来学习得到多个源域分类模型，实现目标域的分类。然后，将得到的多个分类结果进行整合用于目标域分类模型的学习。此外，框架还利用L_2，1范数稀疏回归代替传统的基于L₂范数的最小二乘回归来提高鲁棒性。最后，把多种现有方法在两项任务中与MACFFS进行实验比较分析。实验结果表明，与现有方法中表现最好的DSM相比，MACFFS节省了接近1/4的计算时间，并且提升了大约2%的识别率。总的来说，MACFFS结合了机器学习、统计学习等相关知识，为多源自适应方法提供了一个新的思路，且该方法在现实场景下的识别应用中比现有方法具有更好的性能。

关键词: 多源自适应, 目标识别, 共享特征子空间, 特征选择, 迁移学习

CLC Number:

TP181

HUANG Xueyu, XU Haote, TAO Jianwen. Multi-source adaptation classification framework with feature selection[J]. Journal of Computer Applications, 2020, 40(9): 2499-2506.

黄学雨, 徐浩特, 陶剑文. 具有特征选择的多源自适应分类框架[J]. 计算机应用, 2020, 40(9): 2499-2506.

References

[1] 李茂莹,杨柳,胡清华. 同构迁移学习理论和算法研究进展[J]. 南京信息工程大学学报(自然科学版), 2019, 11(3):269-277.(LI M Y, YANG L, HU Q H. A survey on theories and algorithms about homogeneous transfer learning[J]. Journal of Nanjing University of Information Science and Technology (Natural Science Edition), 2019, 11(3):269-277.)
[2] 韩嵩,韩秋弘. 半监督学习研究的述评[J]. 计算机工程与应用, 2020, 56(6):19-27.(HAN S, HAN Q H. Review of semi-supervised learning research[J]. Computer Engineering and Applications, 2020, 56(6):19-27.)
[3] 贾颖霞,郎丛妍,冯松鹤. 基于类别相关的领域自适应交通图像语义分割方法[J]. 计算机研究与发展, 2020, 57(4):876-887. (JIA Y X, LANG C Y, FENG S H. A semantic segmentation method of traffic scene based on categories-aware domain adaptation[J]. Journal of Computer Research and Development, 2020, 57(4):876-887.)
[4] JIA X, SUN F. Unsupervised deep domain adaptation based on weighted adversarial network[J]. IEEE Access, 2020, 8:64020-64027.
[5] YANG J, YAN R, HAUPTMANN A G. Cross-domain video concept detection using adaptive SVMs[C]//Proceedings of the 15th ACM International Conference on Multimedia. New York:ACM, 2007:188-197.
[6] DUAN L, TSANG I W, XU D. Domain transfer multiple kernel learning[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(3):465-479.
[7] MA Z, NIE F, YANG Y, et al. Web image annotation via subspacesparsity collaborated feature selection[J]. IEEE Transactions on Multimedia, 2012, 14(4):1021-1030.
[8] NIE F, XU D, TSANG I W H, et al. Flexible manifold embedding:a framework for semi-supervised and unsupervised dimension reduction[J]. IEEE Transactions on Image Processing, 2010, 19(7):1921-1932.
[9] 姚哲,陶剑文. 多源适应多标签分类框架[J]. 计算机工程与应用, 2017, 53(7):88-96, 170.(YAO Z, TAO J W. Multi-source adaptation multi-label classification framework via joint sparse feature selection and shared subspace learning[J]. Computer Engineering and Applications, 2017, 53(7):88-96, 170.)
[10] PAN S J, TSANG I W, KWOK J T, et al. Domain adaptation via transfer component analysis[J]. IEEE Transactions on Neural Networks, 2011, 22(2):199-210.
[11] DUAN L, XU D, CHANG S F. Exploiting web images for event recognition in consumer videos:a multiple source domain adaptation approach[C]//Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition. Piscataway:IEEE, 2012:1338-1345.
[12] TOMMASI T, ORABONA F, CAPUTO B. Learning categories from few examples with multi model knowledge transfer[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 36(5):928-941.
[13] GHIFARY M, BALDUZZI D, KLEIJIN W B, et al. Scatter component analysis:a unified framework for domain adaptation and domain generalization[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(7):1414-1430.
[14] GENDREAU M, HERTZ A, LAPORTE G. A tabu search heuristic for the vehicle routing problem[J]. Management Science, 1994, 40(10):1276-1289.
[15] BAY H, ESS A, TUYTELAARS T, et al. Speeded-Up Robust Features(SURF)[J]. Computer Vision and Image Understanding, 2008, 110(3):346-359.
[16] SMEATON A, OVER P, DOHERTY A R, et al. Video shot boundary detection:Seven years of TRECVid activity[J]. Computer Vision and Image Understanding, 2010, 114(4):411-418.
[17] OLIVA A, TORRALBA A. Modeling the shape of the scene:a holistic representation of the spatial envelope[J]. International Journal of Computer Version, 2001, 42(3):145-175.

Multi-source adaptation classification framework with feature selection

具有特征选择的多源自适应分类框架

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	ZHAN Hang, HE Lang, HUANG Zhangcan, LI Huafeng, ZHANG Qiang, TAN Qing. Improved feature selection and classification algorithm for gene expression programming based on layer distance [J]. Journal of Computer Applications, 2021, 41(9): 2658-2667.
[2]	ZHU Cheng, ZHAO Xiaoqi, ZHAO Liping, JIAO Yuhong, ZHU Yafei, CHENG Jianying, ZHOU Wei, TAN Ying. Classification of functional magnetic resonance imaging data based on semi-supervised feature selection by spectral clustering [J]. Journal of Computer Applications, 2021, 41(8): 2288-2293.
[3]	LI Mengmeng, QIN Wei, LIU Yi, DIAO Xingchun. Hybrid ant colony optimization algorithm with brain storm optimization [J]. Journal of Computer Applications, 2021, 41(8): 2412-2417.
[4]	LIU Shuangyuan, ZHENG Wangli, LIN Yunhan. Adaptive binary simplification method for 3D feature descriptor [J]. Journal of Computer Applications, 2021, 41(7): 2062-2069.
[5]	JIA Heming, JIANG Zichao, LI Yao, SUN Kangjian. Simultaneous feature selection optimization based on improved spotted hyena optimizer algorithm [J]. Journal of Computer Applications, 2021, 41(5): 1290-1298.
[6]	LIN Junchao, WAN Yuan. Self-adaptive multi-measure unsupervised feature selection method with structured graph optimization [J]. Journal of Computer Applications, 2021, 41(5): 1282-1289.
[7]	CHEN Zhengtao, HUANG Can, YANG Bo, ZHAO Li, LIAO Yong. Yak face recognition algorithm of parallel convolutional neural network based on transfer learning [J]. Journal of Computer Applications, 2021, 41(5): 1332-1336.
[8]	WANG Jinkai, JIA Xu. Vein recognition algorithm based on Siamese nonnegative matrix factorization with transferability [J]. Journal of Computer Applications, 2021, 41(3): 898-903.
[9]	ZHANG Zhihao, LIN Yaojin, LU Shun, GUO Chen, WANG Chenxi. Multi-label feature selection based on label-specific feature with missing labels [J]. Journal of Computer Applications, 2021, 41(10): 2849-2857.
[10]	GU Tong, XU Guoliang, LI Wanlin, LI Jiahao, WANG Zhiyuan, LUO Jiangtao. Intelligent house price evaluation model based on ensemble LightGBM and Bayesian optimization strategy [J]. Journal of Computer Applications, 2020, 40(9): 2762-2767.
[11]	ZHANG Chenxi, TANG Shu, TANG Ke. Strategies of parameter fault detection for rocket engines based on transfer learning [J]. Journal of Computer Applications, 2020, 40(9): 2774-2780.
[12]	XIAO Yuelei, ZHANG Yunjiao. Terrorist attack organization prediction method based on feature selection and hyperparameter optimization [J]. Journal of Computer Applications, 2020, 40(8): 2262-2267.
[13]	BAI Ruyi, GUO Xiaoying, JIA Chunhua. Sentiment prediction of small sample abstract painting image based on feature fusion [J]. Journal of Computer Applications, 2020, 40(8): 2207-2213.
[14]	LIU Dan, YAO Lishuang, WANG Yunfeng, PEI Zuofei. Classification model for class imbalanced traffic data [J]. Journal of Computer Applications, 2020, 40(8): 2327-2333.
[15]	WANG Zhiyuan, JIANG Ailian, MUHAMMAD Osman. Unsupervised feature selection method based on regularized mutual representation [J]. Journal of Computer Applications, 2020, 40(7): 1896-1900.