局部关注支持向量机算法

doi:10.11772/j.issn.1001-9081.2017092228

计算机应用 ›› 2018, Vol. 38 ›› Issue (4): 945-948.DOI: 10.11772/j.issn.1001-9081.2017092228

局部关注支持向量机算法

周于皓¹, 张红玲¹, 李芳菲², 祁鹏¹

1. 中国石油大学(北京) 石油工程学院, 北京 102249;
2. 武汉纺织大学传媒学院, 武汉 430000

收稿日期:2017-09-12 修回日期:2017-12-18 出版日期:2018-04-10 发布日期:2018-04-09
通讯作者: 周于皓
作者简介:周于皓(1992-),男,山东东营人,硕士研究生,主要研究方向:油气田开发大数据、油气田人工智能;张红玲(1966-),女,山东威海人,副教授,硕士,主要研究方向:油气田开发大数据、油气田数值模拟;李芳菲(1998-),女,山东东营人,主要研究方向:图像增强、计算机视觉;祁鹏(1993-),男,辽宁盘锦人,硕士研究生,主要研究方向:稠油开发、油气田开发大数据。

Local focus support vector machine algorithm

ZHOU Yuhao¹, ZHANG Hongling¹, LI Fangfei², QI Peng¹

1. College of Petroleum Engineering, China University of Petroleum, Beijing 102249, China;
2. School of Media and Communication, Wuhan Textile University, Wuhan Hubei 430000, China

Received:2017-09-12 Revised:2017-12-18 Online:2018-04-10 Published:2018-04-09

摘要/Abstract

摘要： 针对训练数据集的不均衡性这一问题，结合采样方法和集成方法，提出一种集成支持向量机分类算法。该算法首先对不均衡的训练集进行非监督聚类；然后依靠其底层的局部关注支持向量机进行数据集局部划分，以精确把控数据集间的局部特征；最后通过顶层支持向量机进行分类预测。在UCI数据集上的评测结果显示，该算法与当前流行的算法（如基于采样的核化少数类过采样技术（K-SMOTE）、基于集成的梯度提升决策树（GTB）和代价敏感集成算法（AdaCost）等）相比，分类效果有明显提升，能在一定程度上解决数据集的不均衡问题。

关键词: 非均衡数据集, 支持向量机, 集成算法, 非监督聚类

Abstract: Aiming at the imbalance of training data set, an integrated support vector machine classification algorithm was proposed by combining sampling method with ensemble method. Firstly, unsupervised clustering was performed on an unbalanced training set, then the underlying local attention support vector machine was used to partition the data set so as to precisely control the local features of data sets. Finally, top support vector machine was used to predicte classification. The evaluation results on UCI dataset show that compared with the popular algorithms such as sampling based Kernelized Synthetic Minority Over-sampling TEchnique (K-SMOTE), integration based Gradient Tree Boosting (GTB) and cost sensitive ensemble algorithm (AdaCost), the proposed support vector machine algorithm can significantly improve the classification effect and solve the problem of unbalanced data set to a certain extent.

Key words: unbalanced data set, Support Vector Machine (SVM), ensemble algorithm, unsupervised clustering

中图分类号:

TP181

周于皓, 张红玲, 李芳菲, 祁鹏. 局部关注支持向量机算法[J]. 计算机应用, 2018, 38(4): 945-948.

ZHOU Yuhao, ZHANG Hongling, LI Fangfei, QI Peng. Local focus support vector machine algorithm[J]. Journal of Computer Applications, 2018, 38(4): 945-948.

参考文献

[1] BLAGUS R, LUSA L. SMOTE for high-dimensional class-imbalanced data[J]. Bmc Bioinformatics, 2013, 14(1):106.
[2] ZIEBA M, TOMCZAK J M, GONCZAREK A. RBM-SMOTE:restricted Boltzmann machines for synthetic minority oversampling technique[M]//ACⅡDS 2015:Proceedings of the 7th Asian Conference on Intelligent Information and Database Systems. Berlin:Springer, 2015:377-386.
[3] 张永, 李卓然, 刘小丹. 基于主动学习SMOTE的非均衡数据分类[J]. 计算机应用与软件, 2012, 29(3):91-93.(ZHANG Y, LI Z R, LIU X D. Active learning SMOTE based imbalanced data classification[J]. Computer Applications and Software, 2012, 29(3):91-93.)
[4] 杨智明, 乔立岩, 彭喜元. 基于改进SMOTE的不平衡数据挖掘方法研究[J]. 电子学报, 2007, 35(增刊2):22-26.(YANG Z M, QIAO L Y, PENG X Y. Research on datamining method for imbalanced dataset based on i mproved SMOTE[J]. Acta Electronica Sinica, 2007, 35(S2):22-26.)
[5] 曾志强, 吴群, 廖备水, 等. 一种基于核SMOTE的非平衡数据集分类方法[J]. 电子学报, 2009, 37(11):2489-2495.(ZENG Z Q, WU Q, LIAO B S, et al. A classfication method for imbalance data set based on kernel SMOTE[J]. Acta Electronica Sinica, 2009, 37(11):2489-2495.)
[6] 大勇. 基于非平衡数据的适应性采样集成分类器的研究[D]. 长沙:中南大学, 2010:1-42.(DA Y. An adaptive sampling ensemble classifier for learning from imbalanced data sets[D]. Changsha:Central South University, 2010:1-42.)
[7] 谷琼, 袁磊, 熊启军, 等. 基于非均衡数据集的代价敏感学习算法比较研究[J]. 微电子学与计算机, 2011, 28(8):146-149.(GU Q, YUAN L, XIONG Q J, et al. A comparative study of cost-sensitive learning algorithm based on imbalanced data sets[J]. Microelectronics and Computer, 2011, 28(8):146-149.)
[8] ZHU J, ZOU H, ROSSET S, et al. Multi-class AdaBoost[J]. Statistics & its Interface, 2006, 2(3):349-360.
[9] 李正欣, 赵林度. 基于SMOTEBoost的非均衡数据集SVM分类器[J]. 系统工程, 2008, 26(5):116-119.(LI Z X, ZHAO L D. A SVM classifier for imbalanced datasets based on SMOTEBoost[J]. Systems Engineering, 2008, 26(5):116-119.)
[10] ZHANG J. AdaCost:misclassification cost-sensitive boosting[EB/OL].[2017-05-10]. https://pdfs.semanticscholar.org/9ddf/bc2cc5c1b13b80a1a487b9caa57e80edd863.pdf.
[11] GEIBEL P, BREFELD U, WYSOTZKI F. Perceptron and SVM learning with generalized cost models[J]. Intelligent Data Analysis, 2004, 8(5):439-455.
[12] DOMINGOS P. MetaCost:a general method for making classifiers cost-sensitive[C]//KDD 1999:Proceedings of the Fifth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York:ACM, 1999:155-164.
[13] 王金婉. 面向在线不均衡数据分类的极限学习机算法研究[D]. 新乡:河南师范大学, 2016:13-25.(WANG J W. Research on extreme learning machine for online swquential imbalanced data classification[D]. Xinxiang:Henan Normal University, 2016:13-25.)
[14] 毛文涛, 王金婉, 何玲, 等. 面向贯序不均衡数据的混合采样极限学习机[J]. 计算机应用, 2015, 35(8):2221-2226.(MAO W T, WANG J W, HE L, et al. Hybrid sampling extreme learning machine for sequential imbalanced data[J]. Journal of Computer Applications, 2015, 35(8):2221-2226.)
[15] 毛文涛, 田杨阳, 王金婉, 等. 面向贯序不均衡分类的粒度极限学习机[J]. 控制与决策, 2016, 31(12):2147-2154.(MAO W T, TIAN Y Y, WANG J W, et al. Granular extreme learning machine for sequential imbalanced data[J]. Control and Decision, 2016, 31(12):2147-2154.)
[16] ADANKON M M, CHERIET M. Support vector machine[J]. Computer Science, 2002, 1(4):1-28.
[17] 谷琼, 袁磊, 宁彬, 等. 一种基于混合重取样策略的非均衡数据集分类算法[J]. 计算机工程与科学, 2012, 34(10):128-134.(GU Q, YUAN L, NING B, et al. A noval classification algorithm for imbalanced datasets based on hybrid resampling strategy[J]. Computer Engineering and Science, 2012, 34(10):128-134.)

局部关注支持向量机算法

Local focus support vector machine algorithm

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	贾鹤鸣, 姜子超, 李瑶, 孙康健. 基于改进斑点鬣狗优化算法的同步优化特征选择[J]. 计算机应用, 2021, 41(5): 1290-1298.
[2]	袁芊芊, 邓洪敏, 王晓航. 基于超像素快速模糊C均值聚类与支持向量机的柑橘病虫害区域分割[J]. 计算机应用, 2021, 41(2): 563-570.
[3]	李凯, 李洁. 基于pinball损失的结构模糊多分类支持向量机算法[J]. 《计算机应用》唯一官方网站, 2021, 41(11): 3104-3112.
[4]	陆荣秀, 陈明明, 杨辉, 朱建勇. 基于溶液图像时序特征的元素组分含量动态监测系统[J]. 计算机应用, 2021, 41(10): 3075-3081.
[5]	童林, 官铮. 改进鲸鱼优化支持向量机的交通流量模糊粒化预测[J]. 计算机应用, 2021, 41(10): 2919-2927.
[6]	张健铭, 施元昊, 徐正蓺, 魏建明. 基于误差预测的自适应UWB/PDR融合定位算法[J]. 计算机应用, 2020, 40(6): 1755-1762.
[7]	黄功, 赵永平, 谢云龙. 基于局部密度的加权一类支持向量机算法及其在涡轴发动机故障检测中的应用[J]. 计算机应用, 2020, 40(3): 917-924.
[8]	王杨, 赵红东. 基于改进粒子群优化的支持向量机与情景感知的人体活动识别[J]. 计算机应用, 2020, 40(3): 665-671.
[9]	赵一, 段兴, 谢仕义, 梁春林. 面向特定目标自识别的交通图像语义检索方法[J]. 计算机应用, 2020, 40(2): 553-560.
[10]	李卉, 杨志霞. 基于Rescaled Hinge损失函数的多子支持向量机[J]. 计算机应用, 2020, 40(11): 3139-3145.
[11]	牛晓可, 黄伊鑫, 徐华兴, 蒋震阳. 基于听皮层神经元感受野的强噪声环境下说话人识别[J]. 计算机应用, 2020, 40(10): 3034-3040.
[12]	白东颖, 易亚星, 王庆超, 余志勇. 面向概念漂移问题的渐进多核学习方法[J]. 计算机应用, 2019, 39(9): 2494-2498.
[13]	何海琳, 郑建彬, 余方利, 余烈, 詹恩奇. 基于改进鲸鱼优化算法的外骨骼机器人步态检测[J]. 计算机应用, 2019, 39(7): 1905-1911.
[14]	潘建国, 李豪. 基于实用拜占庭容错的物联网入侵检测方法[J]. 计算机应用, 2019, 39(6): 1742-1746.
[15]	孔菁, 郭渊博, 刘春辉, 王一丰. 基于智能手机运动传感器的步态特征身份识别方法[J]. 计算机应用, 2019, 39(6): 1747-1752.