Label propagation algorithm based on LDA model

doi:10.3724/SP.J.1087.2012.00403

Journal of Computer Applications ›› 2012, Vol. 32 ›› Issue (02): 403-410.DOI: 10.3724/SP.J.1087.2012.00403

• Artificial intelligence • Previous Articles Next Articles

Label propagation algorithm based on LDA model

LIU Pei-qi,SUN Jie-han

School of Information and Control Engineering, Xi'an University of Architecture and Technology，Xi'an Shaanxi 710055, China

Received:2011-08-05 Revised:2011-09-21 Online:2012-02-23 Published:2012-02-01
Contact: LIU Pei-qi

基于LDA主题模型的标签传递算法

刘培奇,孙捷焓

西安建筑科技大学信息与控制工程学院，西安 710055

通讯作者: 刘培奇
作者简介:刘培奇(1959-),男,陕西西安人，副教授，博士，主要研究方向：机器学习、数据挖掘、自然语言处理；
孙捷焓(1988-),女,山东济南人，硕士研究生，主要研究方向：机器学习、数据挖掘。

Abstract

Abstract: Label Propagation (LP) algorithm is one kind of semi-supervised learning methods. However, its performance in text classification is not good enough, because LP algorithm demands manifold assumption and it has high computational complexity in calculating the similarity of high dimension data. A new method was proposed to combine Latent Dirichlet Allocation (LDA) model with LP algorithm to solve the above problems after analyzing their principles and complexities. It represented documents with latent topics in LDA. On one hand, it reduces the dimension of matrixes; on the other hand, it can help LDA model lead to the classification results with manifold assumption. The experimental results show that the new method performs better than traditional supervised text classification methods in testing sets when labeled data is less than unlabeled data.

Key words: Latent Dirichlet Allocation (LDA) model, Label Propagation (LP) algorithm, semi-supervised learning, dimensional reduction, manifold assumption

摘要： 标签传递算法是一种半监督分类方法，由于该算法存在要求数据分类结果符合流行假设、数据维数较高时计算复杂度高等问题，在文本分类中效果较差。针对这些问题，经过对LDA主题模型和标签传递算法原理及复杂度的分析，将两者结合，提出一种基于LDA主题模型的标签传递算法LPLDA。该算法用LDA主题模型中的主题表示文本数据，一方面使用LDA主题模型表示文本保证分类结果符合流行假设，另一方面有效减少标签传递算法相似度计算时间。经过实验证明，该算法在标记数据少于待测样本时，分类效果优于传统的有监督分类方法。

关键词: LDA主题模型, 标签传递算法, 半监督学习, 数据降维, 流行假设

CLC Number:

LIU Pei-qi SUN Jie-han. Label propagation algorithm based on LDA model[J]. Journal of Computer Applications, 2012, 32(02): 403-410.

刘培奇孙捷焓. 基于LDA主题模型的标签传递算法[J]. 计算机应用, 2012, 32(02): 403-410.

References

[1]NIGAM K, MCCALLUM A K, THRUN S, et al. Text classification from labeled and unlabeled documents using EM[J]. Machine Learning, 1999,39(2):103-134. [2]许震,沙朝锋,王晓玲,等.基于KL距离的非平衡数据半监督学习算法[J].计算机研究与发展,2010,47(1):81-87. [3]孔祥南,黎铭,姜远,等.一种针对弱标记的直推式多标记分类方法[J].计算机研究与发展，2010,47(8):1392-1399. [4]ZHU XIAOJIN. Semi-supervised learning literature survey, Computer Sciences TR 1530[R/OL]. Madison: University of Wisconsin-Madison, Department of Computer Sciences, 2006 [2011-05-12]. http://pages.cs.wisc.edu/~jerryzhu/pub/ssl_survey.pdf. [5]ZHU X, GHAHRAMANI Z, LAFFERTY J. Semi-supervised learning using Gaussian fields and harmonic functions [C]// ICML 2003: The 20th International Conference on Machine Learning. Palo Alto: AAAI, 2003:912-919. [6]ZHOU D, BOUSQUET O, LAL T N, et al. Learning with local and global consistency [C]// Advances in Neural Information Processing Systems 16: Proceedings of the 2003 Conference. Cambridge: MIT Press, 2004: 321-328. [7]WANG FEI, ZHANG CHANGSHUI. Label propagation through linear neighborhoods [C]// The 23th International Conference on Machine Learning. New York: ACM, 2006:985-992. [8]ZHU X, GHAHRAMANI Z. Learning from labeled and unlabeled data with label propagation, CMU-CALD-02-107 [R]. Pittsburgh: Carnegie Mellon University, Department of Computer Science, 2002. [9]BLEI D M, NG A Y, JORDAN M I. Latent dirichlet allocation[J]. Journal of Machine Learning Research, 2003,3(5): 993-1022. [10]DUMAIS D S, LANDAUER T, FURNAS G, et al. Indexing by latent semantic analysis[J]. Journal of the American Society of Information Science,1998，41(6):391-407. [11]HOFMANN T. Probabilistic latent semantic indexing [C]// Proceedings of the 22nd ACM-SIGIR International Conference on Research and Development in Information Retrieval. New York: ACM, 1999：50-57.〖BP(〗http://www.cs.brown.edu/~th/papers/Hofmann-SIGIR99.pdf〖BP)〗 [12]CAI DENG, MEI QIAOZHU, HAN JIAWEI, et al. Modeling hidden topics on document manifold [C]// CIKM 08: Proceedingof the 17th ACM Conference on Information and Knowledge Management. New York: ACM, 2008: 911-920. [13]石晶,胡明，石鑫，等.基于LDA模型的文本分割[J].计算机学报,2008,31(10):1780-1787. [14]STEYVERS M, GRIFFITHS T. Probabilistic topic models [M]// Latent Semantic Analysis: A Road to Meaning. Mahwah: Lawrence Erlbaum Associates, 2007: 424-440. [15]BLEI D M, GRIFFITHS T L, JORDAN M I, et al. Hierarchical topic models and the nested Chinese restaurant process [C]// Advances in Neural Information Processing Systems 16: Proceedings of the 2003 Conference. Cambridge: MIT Press, 2004:17-24.

Label propagation algorithm based on LDA model

基于LDA主题模型的标签传递算法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	MAO Mingze, CAO Ruihao, YAN Chungang. Semi-supervised classification algorithm based on weight diversity [J]. Journal of Computer Applications, 2021, 41(9): 2473-2480.
[2]	ZHANG Shipeng, LI Yongzhong, DU Xiangtong. Intrusion detection model based on semi-supervised learning and three-way decision [J]. Journal of Computer Applications, 2021, 41(9): 2602-2608.
[3]	CAO Yuhong, XU Hai, LIU Sun'ao, WANG Zixiao, LI Hongliang. Review of deep learning-based medical image segmentation [J]. Journal of Computer Applications, 2021, 41(8): 2273-2287.
[4]	ZOU Zhiwen, QIN Cheng. Method of dynamically constructing spatial topic R-tree based on k-means++ [J]. Journal of Computer Applications, 2021, 41(3): 733-737.
[5]	ZHU Yuna, ZHANG Yutao, YAN Shaoge, FAN Yudan, CHEN Hantuo. Protocol identification approach based on semi-supervised subspace clustering [J]. Journal of Computer Applications, 2021, 41(10): 2900-2904.
[6]	LYU Yali, MIAO Junzhong, HU Weixin. Semi-supervised learning algorithm of graph based on label metric learning [J]. Journal of Computer Applications, 2020, 40(12): 3430-3436.
[7]	CHENG Kai, WANG Yan, LIU Jianfei. Semi-supervised learning method for automatic nuclei segmentation using generative adversarial network [J]. Journal of Computer Applications, 2020, 40(10): 2917-2922.
[8]	CHEN Kejia, YANG Zeyu, LIU Zheng, LU Hao. Graph convolutional network model using neighborhood selection strategy [J]. Journal of Computer Applications, 2019, 39(12): 3415-3419.
[9]	REN Fulong, CAO Peng, WAN Chao, ZHAO Dazhe. Grading of diabetic retinopathy based on cost-sensitive semi-supervised ensemble learning [J]. Journal of Computer Applications, 2018, 38(7): 2124-2129.
[10]	SUN Shengzi, WAN Yuan, ZENG Cheng. Semi-supervised adaptive multi-view embedding method for feature dimension reduction [J]. Journal of Computer Applications, 2018, 38(12): 3391-3398.
[11]	HUANG Hua, ZHENG Jiamin, QIAN Pengjiang. Adjusted cluster assumption and pairwise constraints jointly based semi-supervised classification method [J]. Journal of Computer Applications, 2018, 38(11): 3119-3126.
[12]	LYU Jia, LI Junnan. Self-training method based on semi-supervised clustering and data editing [J]. Journal of Computer Applications, 2018, 38(1): 110-115.
[13]	CHEN Yiying, CHAI Bianfang, LI Wenbin, HE Yichao, WU Congcong. Semi-supervised community detection algorithm using active link selection based on iterative framework [J]. Journal of Computer Applications, 2017, 37(11): 3085-3089.
[14]	ZHU Jie, WU Shufang, XIE Bojun, MA Liyan. Color based compact hierarchical image representation [J]. Journal of Computer Applications, 2017, 37(11): 3238-3243.
[15]	REN Hongge, LI Dongmei, LI Fujin. Dynamic neural network structure design based on semi-supervised learning [J]. Journal of Computer Applications, 2016, 36(3): 703-707.