基于词频信息的改进信息增益文本特征选择算法

doi:10.11772/j.issn.1001-9081.2014.11.3279

计算机应用 ›› 2014, Vol. 34 ›› Issue (11): 3279-3282.DOI: 10.11772/j.issn.1001-9081.2014.11.3279

基于词频信息的改进信息增益文本特征选择算法

石慧¹,贾代平²,苗培¹

1. 山东师范大学信息科学与工程学院, 济南 250014
2. 山东工商学院计算机科学与技术学院,山东烟台 264005

收稿日期:2014-05-16 修回日期:2014-06-26 出版日期:2014-11-01 发布日期:2014-12-01
通讯作者: 石慧
作者简介:石慧(1989-),女,山东临沂人,硕士研究生,主要研究方向:数据挖掘;贾代平(1966-),男,安徽舒城人,教授,CCF高级会员,主要研究方向:动态数据、海量数据;苗培(1991-),女,山东菏泽人,硕士研究生,主要研究方向:差分隐私保护。
基金资助:
国家自然科学基金资助项目

Improved information gain text feature selection algorithm based on word frequency information

SHI Hui¹,JIA Daiping²,MIAO Pei¹

1. School of Information Science and Engineering, Shandong Normal University, Jinan Shandong 250014, China;
2. School of Computer Science and Technology, Shandong Institute of Business and Technology, Yantai Shandong 264005, China

Received:2014-05-16 Revised:2014-06-26 Online:2014-11-01 Published:2014-12-01
Contact: SHI Hui

摘要/Abstract

摘要：

为克服传统信息增益(IG)算法对特征项的频数考虑不足的缺陷,在对传统算法和相关改进算法深入分析的基础上,提出一种基于词频信息的改进的IG文本特征选择算法。分别从特征项在类内出现的频数、类内位置分布、不同类间的分布等方面对传统IG算法的参数进行了修正,使特征频数信息得到充分利用。对文本分类的实验结果表明,所提算法的分类精度明显高于传统IG算法和加权的IG改进算法。

Abstract:

On the basis of elaborate analysis of traditional algorithm and relevant improved algorithms, an improved Information Gain (IG) algorithm based on word frequency information was proposed to solve the insufficient consideration of the frequency of features in traditional information gain feature selection algorithm. The improved algorithm modified parameters of the traditional IG algorithm, mainly from aspects of the frequency of features within category, distribution within category and the distribution among different categories, which can make full use of the frequency of features. The result of text categorization experiment compared with traditional IG algorithm and an improved IG algorithm of weighted indicates that the proposed algorithm has an obvious enhancement in accuracy of the text categorization.

中图分类号:

TP311.13

石慧贾代平苗培. 基于词频信息的改进信息增益文本特征选择算法[J]. 计算机应用, 2014, 34(11): 3279-3282.

SHI Hui JIA Daiping MIAO Pei. Improved information gain text feature selection algorithm based on word frequency information[J]. Journal of Computer Applications, 2014, 34(11): 3279-3282.

参考文献

[1]REN Y, YANG R, YIN M, et al. Information-gain-based text feature selection method[J]. Computer Science,2012,39(11):127-130.(任永功,杨荣杰,尹明飞,等. 基于信息增益的文本特征选择方法[J]. 计算机科学,2012,39(11):127-130.)
[2]NG H T, GOH W B, LOW K L. Feature selection, perception learning and a usability case study for text categorization [C] //Proceedings of the 20th ACM International Conference on Research and Development in Information Retrieval. New York: ACM Press,1997: 67-73.
[3]YANG Y, PEDERSEN J O. A comparative study on feature selec-
tion in text categorization [C]// ICML 1997: Proceedings of the 14th
International Conference on Machine Learning, New York: ACM Press,1997:412-420.
[4]MLADENIC D,GROBELNK M. Feature selection for unbalanced class distribution and naive Bayes[C]// ICML 1999: Proceedings of the Sixteenth International Conference on Machine Learning. New York: ACM Press, 1999: 258-267.
[5]LI W, LIU C, CHEN Y. Classifying text corpus based on information gain weight of feature[J]. Journal of Beijing Polytechnic University, 2006,32(5):456-460.(李文斌,刘椿年,陈嶷瑛. 基于特征信息增益权重的文本分类算法[J]. 北京工业大学学报,2006,32(5):456-460.)
[6]HUANG X, WANG W. Improved feature selection method for text categorization[J]. Computer Engineering and Applications,2009,45(36):129-130.(黄秀丽,王蔚. 一种改进的文本分类特征选择方法[J]. 计算机工程与应用,2009,45(36):129-130.)
[7]GUO S, MA F. Improving the algorithm of information gain feature selection in text classification[J]. Computer Applications and Software,2013,30(8):139-142.(郭颂,马飞. 文本分类中信息增益特征选择算法的改进[J]. 计算机应用与软件,2013,30(8):139-142.)
[8]XU Y, CHEN L. Term-frequency based feature selection methods for text categorization [C]// Proceedings of the 2010 Fourth International Conference on Genetic and Evolutionary Computing. Piscataway: IEEE Press, 2010:280-283.
[9]HU Q, YU D, XIE Z. Neighborhood classifiers[J]. Expert Systems with Applications, 2008,34(2):866-876.
[10]ZHANG Z, LI S, LI Z, et al. Multi-label feature selection algorithm based on information entropy[J]. Journal of Computer Research and Development, 2013,50(6):1177-1184.(张振海,李士宁,李志刚,等. 一类基于信息熵的多标签特征选择算法[J]. 计算机研究与发展,2013,50(6):1177-1184.)
[11]LI M, KAMIL M. Research on feature selection methods and algorithms[J]. Computer Technology and Development,2013,23(12):16-21.(李敏,卡米力·木依丁. 特征选择方法与算法的研究[J]. 计算机技术与发展,2013,23(12):16-21.)
[12]REN Y, YANG X, YANG R, et al. Text feature selection methods based on information gain and feature relation tree[J]. Computer Science,2013,40(10):252-256.(任永功,杨雪,杨荣杰,等. 基于信息增益特征关联树的文本特征选择算法[J]. 计算机科学,2013,40(10):252-256.)

[1]	赵全, 汤小春, 朱紫钰, 毛安琪, 李战怀. 大规模短时间任务的低延迟集群调度框架[J]. 计算机应用, 2021, 41(8): 2396-2405.
[2]	冯钧王秉发陆佳民. 分布式资源描述框架数据管理系统查询性能评价[J]. 计算机应用, 0, (): 0-0.
[3]	李国荣, 冶继民, 甄远婷. 基于新的鲁棒相似性度量的时间序列聚类[J]. 计算机应用, 2021, 41(5): 1343-1347.
[4]	林定康颜嘉麒巴·楠登符朕皓姜皓晨. 门罗币匿名及追踪技术综述[J]. 计算机应用, 0, (): 0-0.
[5]	沈忱, 邰凌翔, 彭煜玮. 面向自动参数调优的动态负载匹配方法[J]. 计算机应用, 2021, 41(3): 657-661.
[6]	杨程, 陆佳民, 冯钧. 分布式环境下大规模资源描述框架数据划分方法综述[J]. 计算机应用, 2020, 40(11): 3184-3191.
[7]	兰海, 韩珂, 申砾, 崔秋, 彭煜玮. TiDB的多索引访问优化[J]. 计算机应用, 2020, 40(2): 410-415.
[8]	崔艺馨, 陈晓东. Spark框架优化的大规模谱聚类并行算法[J]. 计算机应用, 2020, 40(1): 168-172.
[9]	万静, 郑龙君, 何云斌, 李松. 高维不确定数据的子空间聚类算法[J]. 计算机应用, 2019, 39(11): 3280-3287.
[10]	李博, 张晓, 颜靖艺, 李可威, 李恒, 凌玉龙, 张勇. 基于值差度量和聚类优化的K最近邻算法在银行客户行为预测中的应用[J]. 计算机应用, 2019, 39(9): 2784-2788.
[11]	李耘书, 滕飞, 李天瑞. 基于微操作的Hadoop参数自动调优方法[J]. 计算机应用, 2019, 39(6): 1589-1594.
[12]	霍峥, 张坤, 贺萍, 武彦斌. 满足本地化差分隐私的众包位置数据采集[J]. 计算机应用, 2019, 39(3): 763-768.
[13]	朱跃龙, 朱晓晓, 王继民. 基于子序列全连接和最大团的时间序列模体发现算法[J]. 计算机应用, 2019, 39(2): 414-420.
[14]	尹远, 张昌, 文凯, 郑云俊. 基于DiffNodeset结构的最大频繁项集挖掘算法[J]. 计算机应用, 2018, 38(12): 3438-3443.
[15]	曲立平, 吴家喜. 基于评分可靠性的跨域个性化推荐方法[J]. 计算机应用, 2018, 38(11): 3081-3083.

基于词频信息的改进信息增益文本特征选择算法

Improved information gain text feature selection algorithm based on word frequency information

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics