An automatic text classifier of class-based feature selection algorithm

Journal of Computer Applications ›› 2005, Vol. 25 ›› Issue (11): 2658-2660.

• Network and distributed techno • Previous Articles Next Articles

An automatic text classifier of class-based feature selection algorithm

1.School of Information Science and Technology,Jinan University,Guagnzhou Guangdong 510084,China;2.School of Information Science and Technology,Southwest Jiaotong University,Chengdu Sichuan 610031,China

Received:1900-01-01 Revised:1900-01-01 Online:2005-11-01 Published:2005-11-01

基于类别的特征选择算法的文本分类系统

蒋伟贞¹，陶宏才²

1.暨南大学信息科学技术学院； 2.西南交通大学信息科学与技术学院

Abstract

Abstract: Current feature selection algorithms are all based on term frequency,and ignore the class information in the training sample set.A new feature selection algorithm based on class information was put forward.The principle of the algorithm is as follows: according to the similarity difference caused by whether or not a word existed in a document,the discriminative power with that this word distinguished different documents could be determined.And then,the discriminative power was taken as the importance for selection.Based on this algorithm,an automatic English text classifier was designed,and the system test and result analysis were made.

Key words: automatic text classification, feature selection, VSM model, naive Bayes, discriminative power

摘要： 目前的索引词选择算法大多是基于词频的，没有利用训练样本中的类别信息，为此提出了一种新的基于类别的特征选择算法。该算法根据某个词是否存在于文档中导致该类文档相似度的区别，来确定该词区分不同文档的分辨力，以此分辨力作为选取关键词的重要度。以该算法为基础，设计了一个英文文本自动分类系统，并对该系统进行了测试和结果分析。

关键词: 文本自动分类, 特征选择, 向量空间模型, 朴素贝叶斯, 分辨力

CLC Number:

TP391.1

JIANG Wei-zhen,TAO Hong-cai. An automatic text classifier of class-based feature selection algorithm[J]. Journal of Computer Applications, 2005, 25(11): 2658-2660.

蒋伟贞;陶宏才. 基于类别的特征选择算法的文本分类系统[J]. 计算机应用, 2005, 25(11): 2658-2660.

[1]	Hong CHEN, Bing QI, Haibo JIN, Cong WU, Li’ang ZHANG. Class-imbalanced traffic abnormal detection based on 1D-CNN and BiGRU [J]. Journal of Computer Applications, 2024, 44(8): 2493-2499.
[2]	Lin GAO, Yu ZHOU, Tak Wu KWONG. Evolutionary bi-level adaptive local feature selection [J]. Journal of Computer Applications, 2024, 44(5): 1408-1414.
[3]	Mingzhu LEI, Hao WANG, Rong JIA, Lin BAI, Xiaoying PAN. Oversampling algorithm based on synthesizing minority class samples using relationship between features [J]. Journal of Computer Applications, 2024, 44(5): 1428-1436.
[4]	Dapeng XU, Xinmin HOU. Feature selection method for graph neural network based on network architecture design [J]. Journal of Computer Applications, 2024, 44(3): 663-670.
[5]	Shengjie MENG, Wanjun YU, Ying CHEN. Feature selection algorithm for high-dimensional data with maximum correlation and maximum difference [J]. Journal of Computer Applications, 2024, 44(3): 767-771.
[6]	Lin SUN, Menghan LIU. K-means clustering based on adaptive cuckoo optimization feature selection [J]. Journal of Computer Applications, 2024, 44(3): 831-841.
[7]	Jingxin LIU, Wenjing HUANG, Liangsheng XU, Chong HUANG, Jiansheng WU. Unsupervised feature selection model with dictionary learning and sample correlation preservation [J]. Journal of Computer Applications, 2024, 44(12): 3766-3775.
[8]	Tian HE, Zongxin SHEN, Qianqian HUANG, Yanyong HUANG. Adaptive learning-based multi-view unsupervised feature selection method [J]. Journal of Computer Applications, 2023, 43(9): 2657-2664.
[9]	Lin SUN, Jinxu HUANG, Jiucheng XU. Feature selection for imbalanced data based on neighborhood tolerance mutual information and whale optimization algorithm [J]. Journal of Computer Applications, 2023, 43(6): 1842-1854.
[10]	Zhenhua YU, Zhengqi LIU, Ying LIU, Cheng GUO. Feature selection method based on self-adaptive hybrid particle swarm optimization for software defect prediction [J]. Journal of Computer Applications, 2023, 43(4): 1206-1213.
[11]	Lin SUN, Tianjiao MA, Zhan’ao XUE. Multilabel feature selection algorithm based on Fisher score and fuzzy neighborhood entropy [J]. Journal of Computer Applications, 2023, 43(12): 3779-3789.
[12]	Jingcheng XU, Xuebin CHEN, Yanling DONG, Jia YANG. DDoS attack detection by random forest fused with feature selection [J]. Journal of Computer Applications, 2023, 43(11): 3497-3503.
[13]	Lei MA, Chuan LUO, Tianrui LI, Hongmei CHEN. Fuzzy-rough set based unsupervised dynamic feature selection algorithm [J]. Journal of Computer Applications, 2023, 43(10): 3121-3128.
[14]	Liang CHEN, Xianfeng TANG. Improved sine cosine algorithm for optimizing feature selection and data classification [J]. Journal of Computer Applications, 2022, 42(6): 1852-1861.
[15]	Jing ZHAO, Jingyu HAN, Long QIAN, Yi MAO. ECG diagnostic classification based on improved RAKEL algorithm [J]. Journal of Computer Applications, 2022, 42(6): 1892-1897.

An automatic text classifier of class-based feature selection algorithm

基于类别的特征选择算法的文本分类系统

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics