计算机应用 ›› 2012, Vol. 32 ›› Issue (01): 210-212.DOI: 10.3724/SP.J.1087.2012.00210

• 人工智能 • 上一篇    下一篇

基于商空间理论的非平衡数据集分类算法

张健,方宏彬,孙启林,刘明术   

  1. 安徽大学 数学科学学院,合肥 230039
  • 收稿日期:2011-07-15 修回日期:2011-09-21 发布日期:2012-02-06 出版日期:2012-01-01
  • 通讯作者: 张健
  • 作者简介:张健(1981-),男,安徽安庆人,硕士研究生,主要研究方向:机器学习、模式识别;方宏彬(1972-),男,安徽池州人,副教授,博士,主要研究方向:智能计算、信息融合;孙启林(1982-),男,安徽合肥人,硕士研究生,主要研究方向:金融数据挖掘。
  • 基金资助:

    国家自然科学基金资助项目(71071002);安徽省教育厅自然科学基金资助项目(05010428);安徽大学人才队伍建设项目;安徽大学学术创新团队项目(KJTD001B)

Classification algorithm for imbalance dataset based on quotient space theory

ZHANG Jian,FANG Hong-bin,SUN Qi-lin,LIU Mingshu   

  1. School of Mathematical Sciences, Anhui University, Hefei Anhui 230039, China
  • Received:2011-07-15 Revised:2011-09-21 Online:2012-02-06 Published:2012-01-01
  • Contact: ZHANG Jian

摘要: 在机器学习及其分类问题时经常会遇到非平衡数据集,为了提高非平衡数据集分类的有效性,提出了基于商空间理论的过采样分类算法,即QMSVM算法。对训练集中多数类样本进行聚类结构划分,所得划分结果和少数类样本合并进行线性支持向量机(SVM)学习,从而获取多数类样本的支持向量和错分的样本粒;另一方面,获取少数类样本的支持向量和错分的样本,进行SMOTE采样,最后把上述得到的两类样本合并进行SVM学习,这样来实现学习数据集的再平衡处理,从而得到更加合理的分类超平面。实验结果表明,和其他几种算法相比,所提算法虽在正确分类率上有所降低,但较大改善了g_means值和acc+值,且对非平衡率较大的数据集效果会更好。

关键词: 非平衡数据集, 商空间理论, 支持向量机, 过采样, QMSVM算法

Abstract: The application of data classification is usually confronted with a problem named imbalanced dataset in the machine learning. To improve the performance of imbalanced dataset classification, the over-sampling classification algorithm based on quotient space theory (QMSVM) was proposed. The algorithm partitioned majority data on clustering structure, and combined the results and minority data for linear Support Vector Machine (SVM) learning. Support vectors and sample of fault of majority data were obtained from those granules. On the other hand, support vectors and sample of fault of minority data were obtained and the Synthetic Minority Over-sampling Technique (SMOTE) was adopted. Thus, two new kinds of samples were merged for SVM learning, so as to rebalance the training set and get a more reasonable classification of hyperplanes. The experimental results show that, in comparison with several other algorithms, the accuracy of the proposed algorithm decreases, but it significantly improves the g_means value and classification accuracy of positives and the effect is better on the imbalance rate of larger datasets.

Key words: unbalanced dataset, quotient space theory, Support Vector Machine (SVM), over-sampling, QMSVM algorithm

中图分类号: