Phrase based Uyghur language text categorization

doi:10.3724/SP.J.1087.2012.02923

Journal of Computer Applications ›› 2012, Vol. 32 ›› Issue (10): 2923-2926.DOI: 10.3724/SP.J.1087.2012.02923

• Artificial intelligence • Previous Articles Next Articles

Phrase based Uyghur language text categorization

ALIMJAN Aysa¹,²,TURGUN Ibrahim²,KURBAN Obul²,LI Zhe¹

1. Modern Education Technology Center, Xinjiang University, Urumqi Xinjiang 830046, China
2. School of Information Science and Engineering, Xinjiang University, Urumqi Xinjiang 830046,China

Received:2012-05-02 Revised:2012-06-08 Online:2012-10-23 Published:2012-10-01
Contact: ALIMJAN Aysa

基于短语的维吾尔文文本分类

阿力木江·艾沙¹,²,吐尔根·依布拉音²,库尔班·吾布力²,李哲¹

1. 新疆大学现代教育技术中心,乌鲁木齐 830046
2. 新疆大学信息科学与工程学院,乌鲁木齐 830046

通讯作者: 阿力木江·艾沙
作者简介:阿力木江·艾沙（1973-）,男（维吾尔族）,新疆喀什人,副教授,博士研究生,主要研究方向：自然语言处理、信息安全；吐尔根·依布拉音（1958-）,男（维吾尔族）,新疆乌鲁木齐人,教授,博士生导师,主要研究方向：信息处理技术、人工智能；库尔班·吾布力(1974-),男（维吾尔族）,新疆喀什人,副教授,主要研究方向：模式识别；李哲(1977-),女,新疆乌鲁木齐人,讲师,主要研究方向：软件工程。
基金资助:
国家自然科学基金资助项目;国家自然科学基金资助项目

Abstract

Abstract: Text representation is the most important phase in automatic text categorization. In the Vector Space Model (VSM) based text representation, the selection of feature granularity has the direct impact on the text categorization performance. The statistical approach based Uyghur phrase extraction algorithm was proposed and the Uyghur text categorization experiments was conducted using Support Vector Machine (SVM) algorithm based on the extracted phrases as text features. The experimental results show that the phrase based Uyghur text categorization achieves higher classification precision and recall compared to the word based categorization.

Key words: text categorization, phrase extraction, Support Vector Machine (SVM), Uyghur language, Mutual Information (MI)

摘要： 文本特征表示是在文本自动分类中最重要的一个环节。在基于向量空间模型（VSM）的文本表示中特征单元粒度的选择直接影响到文本分类的效果。对于基于词袋模型（BOW）的维吾尔文文本分类效果不理想的问题,提出了一种基于统计方法的维吾尔语短语抽取算法并将抽取到的短语作为文本特征项,采用支持向量机（SVM）算法对维吾尔文文本进行了分类实验。实验结果表明,与以词为特征的文本分类相比,短语作为文本特征能够提高维吾尔文文本分类的准确率和召回率。

关键词: 文本分类, 短语抽取, 支持向量机, 维吾尔语, 互信息

ALIMJAN Aysa TURGUN Ibrahim KURBAN Obul LI Zhe. Phrase based Uyghur language text categorization[J]. Journal of Computer Applications, 2012, 32(10): 2923-2926.

阿力木江·艾沙吐尔根·依布拉音库尔班·吾布力李哲. 基于短语的维吾尔文文本分类[J]. 计算机应用, 2012, 32(10): 2923-2926.

References

［1］苏金树,张博锋,徐昕.基于机器学习的文本分类技术研究进展［J］.软件学报,2006, 17(9):1848-1859. ［2］刘华.基于关键短语的文本分类研究［J］.中文信息学报,2007,21(4):34-41. ［3］ CAROPRESO M F, MATWIN S, SEBASTIANI F. Statistical phrases in automated text categorization,Statistical Phrases in Automated Text Categorization ［R］. Paris: Centre National de la Recherche Scientifique,2000:78-102. ［4］ KOSTER C, BENEY J. Phrase-based document categorization revisited［C］// PaIR09: Proceedings of the 2nd International Workshop on Patent Information Retrieval.New York: ACM, 2009:49-55. ［5］张爱华,荆继武,向继.中文文本分类中的文本表示因素比较［J］.中国科学院研究生院学报,2009,26(3):400-407. ［6］李钝,曹付元,曹元大.基于短语的文本情感分类研究［J］.计算机科学,2008,35(4):132-134. ［7］阿力木江·艾沙,吐尔根·依布拉音,艾山·吾买尔.基于机器学习的维吾尔文文本分类研究［J］.计算机工程与应用,2012,48(5):110-112. ［8］张震,胡学钢.基于互信息量的分类模型［J］.JOCA,2011,36(6):1678-1680. ［9］ VAPNIK V．The nature of statistical learning theory［M］．New York:Springer-Verlag,1995. ［10］ JOACHIMS T. Text categorization with support vector machines: Learning with many relevant features［C］// European Conference on Machine Learning. Berlin: Springer-Verlag, 1998:137-142. ［11］孙建涛,郭崇慧,陆玉昌,等. 多项式核支持向量机文本分类器泛化性能分析［J］. 计算机研究与发展,2004,41（8）:1321-1326. ［12］ HSU C-W, LIN C-J. A comparison of methods for multiclass support vector machines［J］.IEEE Transactions on Neural Networks,2002,13(2):415-440. ［13］ CHANG C-C, LIN C-J. LIBSVM: A library for support vector machines ［EB/OL］. ［2011-09-10］http://www.csie.ntu.edu.tw/~cjlin/libsvm/. ［14］ SEBASTIANI F. Machine learning in automated text categorization[J]. ACM Computing Surveys, 2002,34(1):1-47. ［15］施聪莺, 徐朝军, 杨晓江. TFIDF算法研究综述［J］.JOCA,2009,29（S1）:167-170.

[1]	JIA Heming, JIANG Zichao, LI Yao, SUN Kangjian. Simultaneous feature selection optimization based on improved spotted hyena optimizer algorithm [J]. Journal of Computer Applications, 2021, 41(5): 1290-1298.
[2]	YUAN Qianqian, DENG Hongmin, WANG Xiaohang. Citrus disease and insect pest area segmentation based on superpixel fast fuzzy C-means clustering and support vector machine [J]. Journal of Computer Applications, 2021, 41(2): 563-570.
[3]	Kai LI, Jie LI. Structure-fuzzy multi-class support vector machine algorithm based on pinball loss [J]. Journal of Computer Applications, 2021, 41(11): 3104-3112.
[4]	TONG Lin, GUAN Zheng. Fuzzy granulation prediction of traffic flow based on improved whale optimization support vector machine [J]. Journal of Computer Applications, 2021, 41(10): 2919-2927.
[5]	ZHANG Jianming, SHI Yuanhao, XU Zhengyi, WEI Jianming. Adaptive UWB/PDR fusion positioning algorithm based on error prediction [J]. Journal of Computer Applications, 2020, 40(6): 1755-1762.
[6]	WANG Yang, ZHAO Hongdong. Human activity recognition based on improved particle swarm optimization-support vector machine and context-awareness [J]. Journal of Computer Applications, 2020, 40(3): 665-671.
[7]	LI Hui, YANG Zhixia. Multiple birth support vector machine based on Rescaled Hinge loss function [J]. Journal of Computer Applications, 2020, 40(11): 3139-3145.
[8]	NIU Xiaoke, HUANG Yixin, XU Huaxing, JIANG Zhenyang. Speaker recognition in strong noise environment based on auditory cortical neuronal receptive field [J]. Journal of Computer Applications, 2020, 40(10): 3034-3040.
[9]	BAI Dongying, YI Yaxing, WANG Qingchao, YU Zhiyong. Gradual multi-kernel learning method for concept drift [J]. Journal of Computer Applications, 2019, 39(9): 2494-2498.
[10]	HE Hailin, ZHENG Jianbin, YU Fangli, YU Lie, ZHAN Enqi. Exoskeleton robot gait detection based on improved whale optimization algorithm [J]. Journal of Computer Applications, 2019, 39(7): 1905-1911.
[11]	KONG Jing, GUO Yuanbo, LIU Chunhui, WANG Yifeng. Gait feature identification method based on motion sensor in smartphone [J]. Journal of Computer Applications, 2019, 39(6): 1747-1752.
[12]	MA Jiangang, MA Yinglong. Semantic-driven learning and classification method of judicial documents [J]. Journal of Computer Applications, 2019, 39(6): 1696-1700.
[13]	PAN Jianguo, LI Hao. Intrusion detection approach for IoT based on practical Byzantine fault tolerance [J]. Journal of Computer Applications, 2019, 39(6): 1742-1746.
[14]	WEI Jiawang, WANG Xiao, YUAN Yubo. Adaptive window regression method for face feature point positioning [J]. Journal of Computer Applications, 2019, 39(5): 1459-1465.
[15]	XU Tao, WANG Xiaoming. Generalization error bound guided discriminative dictionary learning [J]. Journal of Computer Applications, 2019, 39(4): 940-948.

Phrase based Uyghur language text categorization

基于短语的维吾尔文文本分类

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics