Gradual multi-kernel learning method for concept drift

doi:10.11772/j.issn.1001-9081.2019020299

Journal of Computer Applications ›› 2019, Vol. 39 ›› Issue (9): 2494-2498.DOI: 10.11772/j.issn.1001-9081.2019020299

• Artificial intelligence • Previous Articles Next Articles

Gradual multi-kernel learning method for concept drift

BAI Dongying1,2, YI Yaxing1, WANG Qingchao1, YU Zhiyong1

1. Institute of Combat and Support. Xi'an Institute of High-Tech, Xi'an Shaanxi 710025, China;
2. Institute of Air and Missile Defense, Air Force Engineering University, Xi'an Shaanxi 710051, China

Received:2019-02-27 Revised:2019-04-29 Online:2019-09-10 Published:2019-05-14
Supported by:
This work is partially supported by the National Natural Science Foundation of China for Young Scholars (61806219).

面向概念漂移问题的渐进多核学习方法

白东颖^1,2, 易亚星¹, 王庆超¹, 余志勇¹

1. 火箭军工程大学作战保障学院, 西安 710025;
2. 空军工程大学防空反导学院, 西安 710051

通讯作者: 易亚星
作者简介:白东颖(1982-),女,陕西宝鸡人,讲师,硕士,主要研究方向:智能信息处理;易亚星(1966-),男,湖南岳阳人,教授,博士,CCF会员,主要研究方向:系统建模与仿真;王庆超(1988-),男,河北清河人,讲师,博士,主要研究方向:遥感图像分析;余志勇(1972-),男,湖北恩施人,教授,博士,主要研究方向:电磁兼容。
基金资助:
国家自然科学基金青年项目（61806219）。

Abstract

Abstract:

Aiming at the concept drift problem, a classification learning model with the characteristics of data changing progressively over time was constructed, and a Gradual Multiple Kenerl Learning method (G-MKL) based on Gradual Support Vector Machine (G-SVM) was proposed. In this method, with Support Vector Machine (SVM) used as the basic classifier, multi-interval sub-classifier coupling training was carried out and the incremental method of constraining sub-classifier was used to adapt the model to the gradual change of data. Finally, multiple kernels were integrated into SVM solution framework in a linear combination manner. This method integrated the advantages of different kernel functions and greatly improved the adaptability and validity of the model. Finally, the comparison experiments between the proposed algorithm and several classical algorithms were carried out on the simulated and real datasets with gradual characteristics, verifying the effectiveness of the proposed algorithm in dealing with non-stationary data problems.

Key words: concept drift, Support Vector Machine (SVM), multi-kernel learning, sub-classifier, Karush-Kuhn-Tucher (KKT) condition

摘要：

针对概念漂移问题，构建数据特性随时间发生渐进变化特点的分类学习模型，提出一种基于渐进支持向量机（G-SVM）的渐进多核学习方法（G-MKL）。该方法采用支持向量机（SVM）为基本分类器，进行多区间上的子分类器耦合训练，并通过约束子分类器增量方式使模型适应数据渐进变化特性，最终将多个核函数以线性组合方式融入SVM求解框架。该方法综合发挥了各个核函数的优势，大大提高了模型适应性和有效性。在具有渐变特性的模拟数据集和真实数据集上将所提算法与多种经典算法进行了对比，验证了所提算法在处理非静态数据问题的有效性。

关键词: 概念漂移, 支持向量机, 多核学习, 子分类器, KKT条件

CLC Number:

TP311

BAI Dongying, YI Yaxing, WANG Qingchao, YU Zhiyong. Gradual multi-kernel learning method for concept drift[J]. Journal of Computer Applications, 2019, 39(9): 2494-2498.

白东颖, 易亚星, 王庆超, 余志勇. 面向概念漂移问题的渐进多核学习方法[J]. 计算机应用, 2019, 39(9): 2494-2498.

References

[1] ?LIOBAITE I, PECHENIZKIY M, GAMA J. An overview of concept drift applications[M]//JAPKOWICZ N, STEFANOWSKI J. Big Data Analysis:New Algorithms for a New Society, SBD 16. Berlin:Springer, 2016:91-114.
[2] 孙宇.针对含有概念漂移问题的增量学习算法研究[D].合肥:中国科学技术大学,2017:12-18.(SUN Y. Research on incremental learning algorithms for conceptual drift problem[D]. Hefei:University of Science and Technology of China, 2017:12-18).
[3] HEWAHI N M, KOHAIL S N. Learning concept drift using adaptive training set formation strategy[J]. International Journal of Technology Diffusion, 2013, 4(1):33-55.
[4] ALIPPI C, BORACCHI G, ROVERI M. An effective just-in-time adaptive classifier for gradual concept drifts[C]//Proceedings of the 2011 International Joint Conference on Neural Networks. Piscataway, NJ:IEEE, 2011:1675-1682.
[5] 史荧中.耦合的支持向量学习方法及应用研究[D].无锡:江南大学,2016:89-106.(SHI Y Z. Study on coupled supported vector method and its application[D]. Wuxi:Jiangnan University, 2016:89-106.)
[6] PALIVELA H, KUBAL D, NIRMALA C R. Multiple kernel learning techniques for ligand based virtual screening[C]//Proceedings of the 2017 International Conference on Computer Communication and Informatics. Piscataway, NJ:IEEE, 2017:1-6.
[7] GRINBLAT G L, UZAL L C, CECCATTO H A, et al. Solving nonstationary classification problems with coupled support vector machines[J]. IEEE Transactions on Neural Networks, 2011, 22(1):37-51.
[8] SHI Y, CHUNG F, WANG S. An improved TA-SVM method without matrix inversion and its fast implementation for nonstationary datasets[J]. IEEE Transactions on Neural Networks and Learning Systems, 2015, 26(9):2005-2018.
[9] 汪洪桥,孙富春,蔡艳宁,等.多核学习方法[J].自动化学报,2010,36(8):1037-1050.(WANG H Q, SUN F C, CAI Y N, et al. On multiple kernel learning methods[J]. Acta Automatica Sinica, 2010, 36(8):1037-1050.)
[10] GÖNEN M, ALPAYDIN E. Multiple kernel learning algorithms[EB/OL].[2018-12-21]. http://delivery.acm.org/10.1145/2030000/2021071/p2211-gonen.pdf?ip=171.221.175.194&id=2021071&acc=OPEN&key=4D4702B0C3E38B35%2E4D4702B0C3E38B35%2E4D4702B0C3E38B35%2E6D218144511F3437&__acm__=1562746429_892bd32fdc36440e5615efc0f82c56b2.
[11] MANOGARAN G, VARATHARAJAN R, PRIYAN M K. Hybrid recommendation system for heart disease diagnosis based on multiple kernel learning with adaptive neuro-fuzzy inference system[J]. Multimedia Tools and Applications, 2018, 77(4):4379-4399.
[12] MARCINIAK M, AREVALO H, TFELT-HANSEN J, et al. A multiple kernel learning framework to investigate the relationship between ventricular fibrillation and first myocardial infarction[C]//Proceedings of the 2017 International Conference on Functional Imaging and Modeling of the Heart, LNCS 10263. Berlin:Springer, 2017:161-171.
[13] LIU T, JIN X, GU Y. Sparse multiple kernel learning for hyperspectral image classification using spatial-spectral features[C]//Proceedings of the 6th International Conference on Instrumentation and Measurement, Computer, Communication and Control. Piscataway, NJ:IEEE, 2016:614-618.
[14] VAPNIK V N. The Nature of Statistical Learning Theory[M]. New York:Springer, 1995:24-30.
[15] HAN Y, YANG K, YANG Y, et al. Localized multiple kernel learning with dynamical clustering and matrix regularization[J]. IEEE Transactions on Neural Networks and Learning Systems, 2018, 29(6):486-499.

Gradual multi-kernel learning method for concept drift

面向概念漂移问题的渐进多核学习方法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	YIN Chunyong, ZHANG Guojie. Ensemble classification model for distributed drifted data streams [J]. Journal of Computer Applications, 2021, 41(7): 1947-1955.
[2]	JIA Heming, JIANG Zichao, LI Yao, SUN Kangjian. Simultaneous feature selection optimization based on improved spotted hyena optimizer algorithm [J]. Journal of Computer Applications, 2021, 41(5): 1290-1298.
[3]	YUAN Qianqian, DENG Hongmin, WANG Xiaohang. Citrus disease and insect pest area segmentation based on superpixel fast fuzzy C-means clustering and support vector machine [J]. Journal of Computer Applications, 2021, 41(2): 563-570.
[4]	Kai LI, Jie LI. Structure-fuzzy multi-class support vector machine algorithm based on pinball loss [J]. Journal of Computer Applications, 2021, 41(11): 3104-3112.
[5]	TONG Lin, GUAN Zheng. Fuzzy granulation prediction of traffic flow based on improved whale optimization support vector machine [J]. Journal of Computer Applications, 2021, 41(10): 2919-2927.
[6]	ZHANG Jianming, SHI Yuanhao, XU Zhengyi, WEI Jianming. Adaptive UWB/PDR fusion positioning algorithm based on error prediction [J]. Journal of Computer Applications, 2020, 40(6): 1755-1762.
[7]	WANG Yang, ZHAO Hongdong. Human activity recognition based on improved particle swarm optimization-support vector machine and context-awareness [J]. Journal of Computer Applications, 2020, 40(3): 665-671.
[8]	LI Hui, YANG Zhixia. Multiple birth support vector machine based on Rescaled Hinge loss function [J]. Journal of Computer Applications, 2020, 40(11): 3139-3145.
[9]	NIU Xiaoke, HUANG Yixin, XU Huaxing, JIANG Zhenyang. Speaker recognition in strong noise environment based on auditory cortical neuronal receptive field [J]. Journal of Computer Applications, 2020, 40(10): 3034-3040.
[10]	LI Yao, ZHAO Yunpeng, LI Xinyun, LIU Zhifen, CHEN Junjie, GUO Hao. Construction of brain functional hypernetwork and feature fusion analysis based on sparse group Lasso method [J]. Journal of Computer Applications, 2020, 40(1): 62-70.
[11]	HE Hailin, ZHENG Jianbin, YU Fangli, YU Lie, ZHAN Enqi. Exoskeleton robot gait detection based on improved whale optimization algorithm [J]. Journal of Computer Applications, 2019, 39(7): 1905-1911.
[12]	KONG Jing, GUO Yuanbo, LIU Chunhui, WANG Yifeng. Gait feature identification method based on motion sensor in smartphone [J]. Journal of Computer Applications, 2019, 39(6): 1747-1752.
[13]	PAN Jianguo, LI Hao. Intrusion detection approach for IoT based on practical Byzantine fault tolerance [J]. Journal of Computer Applications, 2019, 39(6): 1742-1746.
[14]	XU Tao, WANG Xiaoming. Generalization error bound guided discriminative dictionary learning [J]. Journal of Computer Applications, 2019, 39(4): 940-948.
[15]	CHEN Wanzhi, XU Dongsheng, ZHANG Jing, TANG Yu. Intrusion detection method for industrial control system with optimized support vector machine and K-means++ [J]. Journal of Computer Applications, 2019, 39(4): 1089-1094.