Project keyword lexicon and keyword semantic network based on word co-occurrence matrix

doi:10.11772/j.issn.1001-9081.2015.06.1649

Journal of Computer Applications ›› 2015, Vol. 35 ›› Issue (6): 1649-1653.DOI: 10.11772/j.issn.1001-9081.2015.06.1649

Previous Articles Next Articles

Project keyword lexicon and keyword semantic network based on word co-occurrence matrix

WANG Qing^1,2, CHEN Zeya^1,2, GUO Jing^1,2, CHEN Xi³, WANG Jinghua³

1. School of Computer Science and Technology, University of Science and Technology of China, Hefei Anhui 230027, China;
2. Suzhou Institute for Advanced Study, University of Science and Technology of China, Suzhou Jiangsu 215123, China;
3. State Grid Information and Telecommunication Branch, Beijing 100761, China

Received:2015-01-13 Revised:2015-03-26 Published:2015-06-12

基于词共现矩阵的项目关键词词库和关键词语义网络

王庆^1,2, 陈泽亚^1,2, 郭静^1,2, 陈晰³, 王晶华³

1. 中国科学技术大学计算机科学与技术学院, 合肥 230027;
2. 中国科学技术大学苏州研究院, 江苏苏州 215123;
3. 国家电网公司信息通信分公司, 北京 100761

通讯作者: 王庆(1990-),男,山东临沂人,硕士研究生,主要研究方向:无线传感器网络、大数据与云计算;qingwang@mail.ustc.edu.cn
作者简介:陈泽亚(1990-),男,上海人,硕士研究生,主要研究方向:无线传感器网络;郭静(1989-),女,安徽合肥人,硕士研究生,主要研究方向:无线传感器网络、大数据与云计算;陈晰(1980-),男,北京人,高级工程师,博士,主要研究方向:非线性系统、复杂网络;王晶华(1962-),女,北京人,高级工程师,硕士,主要研究方向:智能电网中的数据处理。

Abstract

Abstract:

In order to solve the problems of keyword extraction and project keyword lexicon establishment of technological projects in professional fields, an algorithm for building the lexicon based on semantic relation and co-occurrence matrix was proposed. On the basis of conventional keyword extraction research based on co-occurrence matrix, the algorithm considered several advanced factors such as the location, property and Inverse Document Frequency (IDF) index of the keywords to improve the traditional approach. Meanwhile, a method was given for the establishment of keyword semantic network using co-occurrence matrix and hot keyword identification through computing the similarity with semantic base vector. At last, 882 project experiment documents in power field were used to perform the simulation. And the experimental results show that the proposed algorithm can effectively extract the keywords for the technological projects, establish the keyword correlation network, and has better performance in precision, recall rate and F1-score than the keyword extraction algorithm of Chinese text based on multi-feature fusion.

Key words: keyword extraction, co-occurrence matrix, keyword lexicon, keyword semantic network, power project

摘要：

针对专业领域中科技项目的关键词提取和项目词库建立的问题,提出了一种基于语义关系、利用共现矩阵建立项目关键词词库的方法。该方法在传统的基于共现矩阵提取关键词研究的基础上,综合考虑了关键词在文章中的位置、词性以及逆向文件频率(IDF)等因素,对传统算法进行改进。另外,给出一种利用共现矩阵建立关键词关联网络,并通过计算与语义基向量相似度识别热点关键词的方法。使用882篇电力项目数据进行仿真实验,实验结果表明改进后的方法能够有效对科技项目进行关键词提取,建立关键词关联网络,并在准确率、召回率以及平衡F分数(F1-score)等指标上明显优于基于多特征融合的中文文本关键词提取方法。

关键词: 关键词提取, 共现矩阵, 关键词词库, 关键词语义网络, 电力项目

CLC Number:

TP391.1

WANG Qing, CHEN Zeya, GUO Jing, CHEN Xi, WANG Jinghua. Project keyword lexicon and keyword semantic network based on word co-occurrence matrix[J]. Journal of Computer Applications, 2015, 35(6): 1649-1653.

王庆, 陈泽亚, 郭静, 陈晰, 王晶华. 基于词共现矩阵的项目关键词词库和关键词语义网络[J]. 计算机应用, 2015, 35(6): 1649-1653.

References

[1] FANG J, GUO L, WANG X. Semantically improved automatic keyphrase extraction [J]. Computer Science, 2008, 35(6): 148-151. (方俊, 郭雷, 王晓东.基于语义的关键词提取算法[J].计算机科学, 2008, 35(6):148-151.)
[2] ZHANG Z. Statistical report on Internet development in China [J]. Computer & Network, 2014(2): 5-5. (张紫. 第33次中国互联网络发展状况统计报告[J]. 计算机与网络, 2014(2): 5-5.)
[3] WANG L, HUAI X. Semantic-based keyword extraction algorithm for Chinese text [J]. Computer Engineering, 2012, 38(1): 1-4. (王立霞, 淮晓永.基于语义的中文文本关键词提取算法[J].计算机工程, 2012, 38(1):1-4.)
[4] HE Q, HAO H-W, YIN X-C. Keyword extraction based on multi-feature fusion for Chinese Web pages [C]//Proceedings of the 2011 2nd International Congress on Computer Applications and Computational Science. Berlin: Springer, 2012: 119-124.
[5] LI J, LI P, ZHU Q. An improved TFIDF based approach to extract keywords from Web pages [J]. Computer Applications and Software, 2011, 28(5): 25-27. (李静月, 李培峰, 朱巧明.一种改进的 TFIDF 网页关键词提取方法[J].计算机应用与软件, 2011, 28(5):25-27.)
[6] YANG C, HAN Y. Fast algorithm of keywords automatic extraction in field [J]. Computer Engineering and Design, 2011, 32(6): 2142-2145. (杨春明, 韩永国.快速的领域文档关键词自动提取算法[J].计算机工程与设计, 2011, 32(6):2142-2145.)
[7] LU Y, LI R, WEN K, et al. Automatic keyword extraction for scientific literatures using references[C]//Proceedings of the 2014 International Conference on Innovative Design and Manufacturing. Piscataway: IEEE, 2014: 78-81.
[8] CHEN C, LUO P, WANG S. Extraction of keywords with citation information [J]. Library and Information Service, 2014, 58(1): 101-108, 116. (陈翀, 罗鹏程, 汪十红.利用引用信息的关键词提取[J].图书情报工作, 2014, 58(1):101-108, 116.)
[9] PARK N H, JOO K H. Log based keyword extraction and spread based clustering for an efficient information searching [J]//International Journal of Software Engineering and Its Applications, 2013, 7(6):201.
[10] LI P, WANG B, SHI Z, et al. Tag-TextRank: a webpage keyword extraction method based on tags [J]. Journal of Computer Research and Development, 2012, 49(11): 2344-2351. (李鹏, 王斌, 石志伟, 等.Tag-TextRank:一种基于 Tag 的网页关键词抽取方法[J].计算机研究与发展, 2012, 49(11):2344-2351.)
[11] YANG S, ZHANG B, LI S, et al. Keyword extraction using multiple novel features [J]. Journal of Computational Information Systems, 2014, 10(7): 2795-2802.
[12] LI G, DAI Q. Keywords automatic indexing based on lexical chains [J]. Documentation, Information and Knowledge, 2011(3): 67-71. (李纲, 戴强斌.基于词汇链的关键词自动标引方法[J].图书情报知识, 2011(3):67-71.)
[13] State Grid Information and Telecommunication Branch. State grid[EB/OL]. [2014-12-01]. http://www.sgcc.com.cn/.(国家电网公司信息通信分公司.国家电网公司[EB/OL].[2014-12-01].http://www.sgcc.com.cn/.)
[14] AIZAWA A. An information-theoretic perspective of tf-idf measures [J]. Information Processing and Management, 2003, 39(1): 45-65.
[15] DEHAK N, DEHAK R, GLASS J, et al. Cosine similarity scoring without score normalization techniques [EB/OL]. [2014-12-01]. http://groups.csail.mit.edu/sls/publications/2010/Dehak_Odyssey.pdf.
[16] MONGE A, ELKAN C. The field matching problem: algorithms and applications[C]//KDD 1996: Proceedings of the 1996 Knowledge Discovery and Data Mining (International Conference). Menlo Park: AAAI Press, 1996: 267-270.
[17] LEI Y, LI Y, WANG C, et al. Method on entity identification using similarity measure base on the weight of Markov random walk [J]. Journal of Hebei Normal University: Natural Science Edition, 2010, 34(1): 26-30. (雷钰丽, 李阳, 王崇骏, 等.基于权重的马尔可夫随机游走相似度度量的实体识别方法[J].河北师范大学学报:自然科学版, 2010, 34(1):26-30.)
[18] ZHANG J. Chinese text keyword extraction method based on multi-feature fusion [J]. Information Studies: Theory and Application, 2013, 36(10): 105-108.(张建娥.基于多特征融合的中文文本关键词提取方法[J].情报理论与实践, 2013, 36(10):105-108.)

Project keyword lexicon and keyword semantic network based on word co-occurrence matrix

基于词共现矩阵的项目关键词词库和关键词语义网络

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	YANG Mengmeng, ZHANG Aihua. Fractal image compression based on gray-level co-occurrence matrix and simultaneous orthogonal matching pursuit [J]. Journal of Computer Applications, 2021, 41(5): 1445-1449.
[2]	LI Ming, GUO Chenhao, CHEN Xing. Automatic annotation of visual deep neural network [J]. Journal of Computer Applications, 2020, 40(6): 1593-1600.
[3]	ZHANG Yubo, ZHANG Yadong, ZHANG Bin. Desktop dust detection algorithm based on gray gradient co-occurrence matrix [J]. Journal of Computer Applications, 2019, 39(8): 2414-2419.
[4]	LI Lin, ZHANG Tao. Zenithal pedestrian detection algorithm based on improved aggregate channel features and gray-level co-occurrence matrix [J]. Journal of Computer Applications, 2018, 38(12): 3367-3371.
[5]	LI Yang, LI Qing, ZHANG Xia. Automatic protocol format signature construction algorithm based on discrete series protocol message [J]. Journal of Computer Applications, 2017, 37(4): 954-959.
[6]	LUO Yan, ZHAO Shuliang, LI Xiaochao, HAN Yuhui, DING Yafei. Text keyword extraction method based on word frequency statistics [J]. Journal of Computer Applications, 2016, 36(3): 718-725.
[7]	YE Jingjing, LI Lin, ZHONG Luo. Keyword extraction method for microblog based on hashtag [J]. Journal of Computer Applications, 2016, 36(2): 563-567.
[8]	ZHAO Jiapeng, LIN Min. Information extraction of history evolution based on Wikipedia [J]. Journal of Computer Applications, 2015, 35(4): 1021-1025.
[9]	ZHANG Yongku, LI Yunfeng, SUN Jinguang. Image retrieval based on multi-feature fusion [J]. Journal of Computer Applications, 2015, 35(2): 495-498.
[10]	LI Pengju, LIU Hui, WANG Bin, WANG Long. Blowing state recognition of basic oxygen furnace based on feature of flame color texture complexity [J]. Journal of Computer Applications, 2015, 35(1): 283-288.
[11]	XIE Guocheng JIANG Yun CHEN Na. New medical image classification approach based on hypersphere multi-class support vector data description [J]. Journal of Computer Applications, 2013, 33(11): 3300-3304.
[12]	LIU Xiao-liang. BBS topic tracking method for military public opinion based on Wikipedia [J]. Journal of Computer Applications, 2012, 32(11): 3026-3029.
[13]	WANG Jing HE Jian-nong. New algorithm of remote sensing image classification based on K-type support vector machine [J]. Journal of Computer Applications, 2012, 32(10): 2832-2835.
[14]	YANG Bing-qing TIAN Xiao-ping WU Cheng-mao. Enhancement algorithm for color images based on co-occurrence matrix [J]. Journal of Computer Applications, 2012, 32(09): 2573-2575.
[15]	OU Jiajia CAI Biye XIONG Bin LI Feng. Detection of image region-duplication forgery based on gray level co-occurrence matrix [J]. Journal of Computer Applications, 2011, 31(06): 1628-1630.