New algorithm for SVM-Based incremental learning

• Artificial intelligence • Previous Articles Next Articles

New algorithm for SVM-Based incremental learning

Received:2006-04-10 Revised:1900-01-01 Online:2006-10-01 Published:2006-10-01
Contact: XiaoDan Wang

一种新的SVM对等增量学习算法

王晓丹郑春颖，吴崇明

空军工程大学导弹学院计算机工程系

通讯作者: 王晓丹

Abstract

Abstract: Based on the analysis of the relation between the Karush-Kuhn-Tucker (KKT) conditions of Support Vector Machine（SVM） and the distribution of the training samples, the possible changes of support vector set after new samples are added to training set were analyzed, and the generalized Karush-Kuhn-Tucker conditions were defined. Based on the equivalence between the original training set and the newly added training set, a new algorithm for SVM-based incremental learning was proposed. With this algorithm, the useless samples were discarded and the useful training samples of importance were reserved. Experimental results with the standard dataset indicate the effectiveness of the proposed algorithm.

Key words: Support Vector Machine（SVM）, incremental learning

摘要： 在分析支持向量机（SVM）寻优问题的KKT条件和样本分布之间关系的基础上，分析了新增样本的加入对SV集的影响，定义了广义KKT条件。基于原训练样本集和新增训练样本集在增量训练中地位等同，提出了一种新的SVM增量学习算法。算法在及时淘汰对后继分类影响不大的样本的同时保留了含有重要分类信息的样本。对标准数据集的实验结果表明，算法获得了较好的性能。

关键词: 支持向量机, 增量学习

XiaoDan Wang . New algorithm for SVM-Based incremental learning[J]. Journal of Computer Applications.

王晓丹郑春颖;吴崇明 . 一种新的SVM对等增量学习算法[J]. 计算机应用.

[1]	Xue LI, Guangle YAO, Honghui WANG, Jun LI, Haoran ZHOU, Shaoze YE. Remote sensing image classification based on sample incremental learning [J]. Journal of Computer Applications, 2024, 44(3): 732-736.
[2]	Jianli DING, Hui HUANG, Weidong CAO. Dynamic monitoring method of flight chain operation status [J]. Journal of Computer Applications, 2024, 44(12): 3941-3948.
[3]	Le WANG, Meng HAN, Xiaojuan LI, Ni ZHANG, Haodong CHENG. Ensemble classification algorithm based on dynamic weighting function [J]. Journal of Computer Applications, 2022, 42(4): 1137-1147.
[4]	Jing LIU, Zhihong DONG, Zheyu ZHANG, Zhigang SUN, Haipeng JI. Data sharing method of industrial internet of things based on federal incremental learning [J]. Journal of Computer Applications, 2022, 42(4): 1235-1243.
[5]	Chao LIU, Lei WANG, Wen YANG, Qiangqiang ZHONG, Min LI. Incremental attribute reduction method for set-valued decision information system with variable attribute sets [J]. Journal of Computer Applications, 2022, 42(2): 463-468.
[6]	LUO Changyin, CHEN Xuebin, MA Chundi, WANG Junyu. Online federated incremental learning algorithm for blockchain [J]. Journal of Computer Applications, 2021, 41(2): 363-371.
[7]	DENG Wenhan, ZHANG Ming, WANG Lijin, ZHONG Yiwen. Hybrid population-based incremental learning algorithm for solving closed-loop layout problem [J]. Journal of Computer Applications, 2021, 41(1): 95-102.
[8]	LIU Dan, YAO Lishuang, WANG Yunfeng, PEI Zuofei. Classification model for class imbalanced traffic data [J]. Journal of Computer Applications, 2020, 40(8): 2327-2333.
[9]	Keyun LUO, Baoliu YE, Bin TANG, Feng MEI, Wenda LU. Incremental learning based proactive caching mechanism for RocksDB key-value system [J]. Journal of Computer Applications, 2020, 40(2): 321-327.
[10]	YANG Liangdong, YANG Zhixia. Incremental robust non-negative matrix factorization with sparseness constraints and its application [J]. Journal of Computer Applications, 2019, 39(5): 1275-1281.
[11]	CHEN Ping, GONG Xun. Face alignment method based on scale self-adaption and incremental learning [J]. Journal of Computer Applications, 2018, 38(7): 2064-2069.
[12]	HU Lisha, WANG Suzhen, CHEN Yiqiang, HU Chunyu, JIANG Xinlong, CHEN Zhenyu, GAO Xingyu. Objective equilibrium measurement based kernelized incremental learning method for fall detection [J]. Journal of Computer Applications, 2018, 38(4): 928-934.
[13]	WANG Jintao, CAO Yudong, SUN Fuming. Incremental learning algorithm based on graph regularized non-negative matrix factorization with sparseness constraints [J]. Journal of Computer Applications, 2017, 37(4): 1071-1074.
[14]	HUO Weigang, QU Feng, CHENG Zhen. Incremental fuzzy associative classification method based on evolving vector quantization clustering algorithm [J]. Journal of Computer Applications, 2017, 37(11): 3075-3079.
[15]	CHEN Bin, DONG Yizhou, MAO Mingrong. Spam detection model of campus network based on incremental learning algorithm [J]. Journal of Computer Applications, 2017, 37(1): 206-211.