Information extraction method of financial events based on lexical-semantic pattern

doi:10.11772/j.issn.1001-9081.2017071678

Journal of Computer Applications ›› 2018, Vol. 38 ›› Issue (1): 84-90.DOI: 10.11772/j.issn.1001-9081.2017071678

Previous Articles Next Articles

Information extraction method of financial events based on lexical-semantic pattern

LUO Ming¹, HUANG Hailiang^1,2

1. College of Information Management and Engineering, Shanghai University of Finance and Economics, Shanghai 200433, China;
2. Shanghai Key Laboratory of Financial Information Technology, Shanghai University of Finance and Economics, Shanghai 200433, China

Received:2017-07-10 Revised:2017-09-09 Online:2018-01-10 Published:2018-01-22
Supported by:
This work is partially supported by the Shanghai Science and Technology Talents Project (14XD1421000), the Shanghai Science and Technology Innovation Action Plan Project (16511102900).

基于词汇语义模式的金融事件信息抽取方法

罗明¹, 黄海量^1,2

1. 上海财经大学信息管理与工程学院, 上海 200433;
2. 上海财经大学上海市金融信息技术研究重点实验室, 上海 200433

通讯作者: 黄海量
作者简介:罗明(1974-),男,重庆人,高级工程师,博士,主要研究方向:数据挖掘、自然语言处理、人工智能;黄海量(1975-),男,江苏无锡人,教授,博士,主要研究方向:大数据及AI方法在财经领域内的应用。
基金资助:
上海市科技人才计划项目（14XD1421000）；上海市科技创新行动计划项目（16511102900）。

Abstract

Abstract: Information extraction is one of the most important tasks in natural language processing. A hierarchical Lexical-Semantic Pattern (LSP) method for the extraction of financial events was proposed for the problem of information extraction in natural language processing due to linguistic diversity, ambiguity and structure. Firstly, a financial event representation model was defined. Secondly, a word vector method based on deep learning was used to realize the automatic generation of synonymous concept dictionary. Finally, some hierarchical LSPs based on finite state machine were used to extract various kinds of financial events. The experimental results show that by using the proposed method various kinds of financial events can be accurately extracted from the financial news text, and for 26 types of financial events recognition the micro average precision is 93.9%, the micro average recall is 86.9%, the micro average F1 value reaches 90.3%.

Key words: Lexical-Semantic Pattern (LSP), information extraction, financial event, word vector, word list, concept gazetteer

摘要： 信息抽取是自然语言处理工作中的重要任务之一。针对由于自然语言的多样性、歧义性和结构性而导致的信息抽取困难的问题，提出了一种面向金融事件信息抽取的层次化词汇-语义模式方法。首先，定义了一个金融事件表示模型；然后应用基于深度学习的词向量方法来实现自动生成同义概念词典；最后采用基于有限状态机驱动的层次化词汇-语义规则模式实现了对各类金融事件信息自动抽取的目标。实验结果表明，所提方法可以从金融新闻文本中准确地抽取出各类金融事件信息，并且对26类金融事件的微平均识别准确率达到93.9%，微平均召回率达到86.9%，微平均F1值达到90.3%。

关键词: 词汇-语义模式, 信息抽取, 金融事件, 词向量, 词列表, 概念词典

CLC Number:

TP181

LUO Ming, HUANG Hailiang. Information extraction method of financial events based on lexical-semantic pattern[J]. Journal of Computer Applications, 2018, 38(1): 84-90.

罗明, 黄海量. 基于词汇语义模式的金融事件信息抽取方法[J]. 计算机应用, 2018, 38(1): 84-90.

References

[1] 中国中文信息学会.中文信息处理发展报告[EB/OL].(2016-12-23)[2017-01-15].http://cips-upload.bj.bcebos.com/cips2016.pdf. (Chinese Information Processing Society of China. Chinese information processing development report[EB/OL].(2016-12-23)[2017-01-15]. http://cips-upload.bj.bcebos.com/cips2016.pdf.)
[2] LI P, ZHU Q, DIAO H, et al. Joint modeling of trigger identification and event type determination in Chinese event extraction[C]//COLING 2012:Proceedings of the 24th International Conference on Computational Linguistics. Mumbai:[s.n.], 2012:1635-1652.
[3] HOGENBOOM F, FRASINCAR F, KAYMAK U, et al. A survey of event extraction methods from text for decision support systems[J]. Decision Support Systems, 2016, 85:12-22.
[4] 罗明,黄海量.一种基于有限状态机的中文地址标准化方法[J].计算机应用研究,2016,33(12):3691-3695.(LUO M, HUANG H L. New method of Chinese address standardization based on finite state machine theory[J]. Application Research of Computers, 2016, 33(12):3691-3695.)
[5] CHANG C H, CHUANG H M, HUANG C Y, et al. Enhancing POI search on maps via online address extraction and associated information segmentation[J]. Applied Intelligence, 2016, 44(3):539-556.
[6] AL ZAMIL M G H, CAN A B, et al. ROLEX-SP:rules of lexical syntactic patterns for free text categorization[J]. Knowledge-Based Systems, 2011, 24(1):58-65.
[7] 刘丹丹,彭成,钱龙华,等.词汇语义信息对中文实体关系抽取影响的比较[J].计算机应用,2012,32(8):2238-2244.(LIU D D, PENG C, QIAN L H, et al. Comparative analysis of impact of lexical semantic information on Chinese entity relation extraction[J].Journal of Computer Applications, 2012, 32(8):2238-2244.)
[8] 宗成庆.统计自然语言处理[M].2版.北京:清华大学出版社,2013:110-128.(ZONG C Q. Statistical Natural Language Processing[M]. 2nd ed. Beijing:Tsinghua University Press, 2013:110-128.)
[9] 李培峰,周国栋,朱巧明.基于语义的中文事件触发词抽取联合模型[J].软件学报,2016,27(2):280-294.(LI P F, ZHOU G D, ZHU Q M. Semantics-based joint model of Chinese event trigger extraction[J]. Journal of Software, 2016, 27(2):280-294.)
[10] ATKINSON M, DU M, PISKORSKI J, et al. Techniques for multilingual security-related event extraction from online news[M]//Computational Linguistics. Berlin:Springer, 2013:163-186.
[11] 孙明.语义Web使用挖掘若干关键技术研究[D].成都:电子科技大学,2009:37-49.(SUN M. Research on some key issues for semantic Web usage mining[D]. Chengdu:University of Electronic Science and Technology of China, 2009:37-49.)
[12] WANG W, ZHAO D, et al. Ontology-based event modeling for semantic understanding of Chinese news story[M]//Natural Language Processing and Chinese Computing. Berlin:Springer, 2012:58-68.
[13] ZHANG Y, LIU J. Microblogging short text classification based on Word2Vec[C]//Proceedings of the 2016 International Conference on Electronic, Mechanical, Information and Management.[S.l.]:Atlantis Press, 2016:395-401.
[14] CUNNINGHAM H, MAYNARD D, BONTCHEVA K, et al. GATE:a framework and graphical development environment for robust NLP tools and applications[C]//Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics. Oxford:Oxford University Press, 2002:47-51.
[15] CUNNINGHAM H, MAYNARD D, TABLAN V, et al. JAPE:a Java Annotation Patterns Engine[EB/OL]. (2000-10-12)[2016-06-12]. http://www.dcs.shef.ac.uk/intranet/research/public/resmes/CS0010.pdf.
[16] FUENTES-LORENZO D, NDEZ N, FISTEUS J, et al. Improving large-scale search engines with semantic annotations[J]. Expert Systems with Applications, 2013, 40(6):2287-2296.
[17] GOOCH P, ROUDSARI A. Lexical patterns, features and knowledge resources for conference resolution in clinical notes[J]. Journal of Biomedical Informatics, 2012, 45(5):901-912.
[18] FERNANDEZ M, PICCOLO L S G, MAYNARD D, et al. Talking climate change via social media:communication, engagement and behavior[C]//Proceedings of the 2016 ACM Conference on Web Science. New York:ACM, 2016:85-94.
[19] 王俊华,左万利,彭涛.面向文本的本体学习方法[J].吉林大学学报(工学版),2015,45(1):236-244.(WANG J H, ZUO W L, PENG T. Test-oriented ontology learning methods[J]. Journal of Jilin University (Engineering and Technology Edition), 2015, 45(1):236-244.)
[20] MIKOLOV T, SUTSKEVER I, CHEN K, et al. Distributed representations of words and phrases and their compositionality[C]//Proceedings of the 2013 International Conference on Neural Information Processing Systems. West Chester, OH:Curran Associates Inc., 2013:3111-3119.
[21] ALTINEL B, DIRI B, GANIZ M C. A novel semantic smoothing kernel for text classification with class-based weighting[J]. Knowledge-Based Systems, 2015, 89:265-277.
[22] ZHANG L, JIANG L, LI C, et al. Two feature weighting approaches for naive Bayes text classifiers[J]. Knowledge-Based Systems, 2016, 100:137-144.
[23] ZHANG X, LI Y, KOTAGIRI R, et al. KRNN:K, Rare-class nearest neighbour classification[J]. Pattern Recognition, 2016, 62:33-44.
[24] 李文波,孙乐,张大鲲.基于Labeled-LDA模型的文本分类新算法[J].计算机学报,2008,31(4):620-627.(LI W B, SUN L, ZHANG D K. Text classification based on labeled-LDA model[J]. Chinese Journal of Computers, 2008, 31(4):620-627.)

Information extraction method of financial events based on lexical-semantic pattern

基于词汇语义模式的金融事件信息抽取方法

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

[1]	WANG Wei, ZHAO Erping, CUI Zhiyuan, SUN Hao. Disambiguation method of multi-feature fusion based on HowNet sememe and Word2vec word embedding representation [J]. Journal of Computer Applications, 2021, 41(8): 2193-2198.
[2]	CUI Bowen, JIN Tao, WANG Jianmin. Overview of information extraction of free-text electronic medical records [J]. Journal of Computer Applications, 2021, 41(4): 1055-1063.
[3]	WEN Chaodong, ZENG Cheng, REN Junwei, ZHANG Yan. Patent text classification based on ALBERT and bidirectional gated recurrent unit [J]. Journal of Computer Applications, 2021, 41(2): 407-412.
[4]	ZHANG Xinyi, FENG Shimin, DING Enjie. Entity recognition and relation extraction model for coal mine [J]. Journal of Computer Applications, 2020, 40(8): 2182-2188.
[5]	WANG Yue, WANG Mengxuan, ZHANG Sheng, DU Wen. Alarm text named entity recognition based on BERT [J]. Journal of Computer Applications, 2020, 40(2): 535-540.
[6]	MENG Zhao, TIAN Shengwei, YU Long, WANG Ruijin. Regional bullying recognition based on joint hierarchical attentional network and independent recurrent neural network [J]. Journal of Computer Applications, 2019, 39(8): 2450-2455.
[7]	WU Ting, CAO Chunping. Aspect level sentiment classification model with location weight and long-short term memory based on attention-over-attention [J]. Journal of Computer Applications, 2019, 39(8): 2198-2203.
[8]	ZHANG Kejun, LI Weinan, QIAN Rong, SHI Taimeng, JIAO Meng. Automatic text summarization scheme based on deep learning [J]. Journal of Computer Applications, 2019, 39(2): 311-315.
[9]	LI ping, DAI Yueming, WU Dinghui. Application of dual-channel convolutional neural network in sentiment analysis [J]. Journal of Computer Applications, 2018, 38(6): 1542-1546.
[10]	LI Yang, DONG Hongbin. Text sentiment analysis based on feature fusion of convolution neural network and bidirectional long short-term memory network [J]. Journal of Computer Applications, 2018, 38(11): 3075-3080.
[11]	XIANG Jingjing, GENG Guanggang, LI Xiaodong. Key information extraction algorithm of news Web pages [J]. Journal of Computer Applications, 2016, 36(8): 2082-2086.
[12]	ZHANG Junchi, HU Jie, LIU Mengchi. Chinese natural language interface based on paraphrasing [J]. Journal of Computer Applications, 2016, 36(5): 1290-1295.
[13]	ZHANG Zhihua, WANG Jianxiang, TIAN Junfeng, WU Guoshun, LAN Man. Blocked person relation recognition system based on multiple features [J]. Journal of Computer Applications, 2016, 36(3): 751-757.
[14]	CHEN Xin, WANG Suge, LIAO Jian. Automatic identification of new sentiment word about microblog based on word association [J]. Journal of Computer Applications, 2016, 36(2): 424-427.
[15]	MA Jianhong, ZHANG Mingyue, ZHAO Yanan. Patent knowledge extraction method for innovation design [J]. Journal of Computer Applications, 2016, 36(2): 465-471.