融合情感词典与上下文语言模型的文本情感分析

doi:10.11772/j.issn.1001-9081.2020121900

计算机应用 ›› 2021, Vol. 41 ›› Issue (10): 2829-2834.DOI: 10.11772/j.issn.1001-9081.2020121900

所属专题：人工智能

融合情感词典与上下文语言模型的文本情感分析

杨书新, 张楠

江西理工大学信息工程学院, 江西赣州 341000

收稿日期:2020-12-04 修回日期:2021-04-14 出版日期:2021-10-10 发布日期:2021-07-14
通讯作者: 杨书新
作者简介:杨书新(1978-),男,江西九江人,副教授,博士,CCF会员,主要研究方向:自然语言处理、图数据管理、生物信息学;张楠(1994-),男,宁夏中卫人,硕士研究生,主要研究方向:自然语言处理。
基金资助:
国家自然科学基金资助项目（61662028）；江西省教育厅科学技术研究项目（GJJ170518）；江西省研究生创新专项（YC2018-S331）。

Text sentiment analysis based on sentiment lexicon and context language model

YANG Shuxin, ZHANG Nan

School of Information Engineering, Jiangxi University of Science and Technology, Ganzhou Jiangxi 341000, China

Received:2020-12-04 Revised:2021-04-14 Online:2021-10-10 Published:2021-07-14
Supported by:
This work is partially supported by the National Natural Science Foundation of China (61662028), the Science and Technology Research Project of Education Department of Jiangxi Province (GJJ170518), the Special Funds for Postgraduate Innovation of Jiangxi Province (YC2018-S331).

摘要/Abstract

摘要： 词嵌入技术在文本情感分析中发挥着重要的作用，但是传统的Word2Vec、GloVe等词嵌入技术会产生语义单一的问题。针对上述问题提出了一种融合情感词典与上下文语言模型ELMo的文本情感分析模型SLP-ELMo。首先，利用情感词典对句子中的单词进行筛选；其次，将筛选出的单词输入字符卷积神经网络（char-CNN），从而产生每个单词的字符向量；然后，将字符向量输入ELMo模型进行训练；此外，在ELMo向量的最后一层加入了注意力机制，以便更好地训练词向量；最后，将词向量与ELMo向量并行融合并输入分类器进行文本情感分类。与现有的多个模型对比，所提模型在IMDB和SST-2这两个数据集上均得到了更高的准确率，验证了模型的有效性。

关键词: 情感分析, ELMo, 情感词典, 卷积神经网络, 字符向量

Abstract: Word embedding technology plays an important role in text sentiment analysis, but the traditional word embedding technologies such as Word2Vec and GloVe (Global Vectors for word representation) will lead to the problem of single semantics. Aiming at the above problem, a text sentiment analysis model named Sentiment Lexicon Parallel-Embedding from Language Model (SLP-ELMo) based on sentiment lexicon and context language model named Embedding from Language Model (ELMo) was proposed. Firstly, the sentiment lexicon was used to filter the words in the sentence. Secondly, the filtered words were input into the character-level Convolutional Neural Network (char-CNN) to generate the character vector of each word. Then, the character vectors were input into ELMo model for training. In addition, the attention mechanism was added to the last layer of ELMo vector to train the word vectors better. Finally, the word vectors and ELMo vector were combined in parallel and input into the classifier for text sentiment classification. Compared with the existing models, the proposed model achieves higher accuracy on IMDB and SST-2 datasets, which validates the effectiveness of the model.

Key words: sentiment analysis, Embedding from Language Model (ELMo), sentiment lexicon, Convolutional Neural Network (CNN), character vector

中图分类号:

杨书新, 张楠. 融合情感词典与上下文语言模型的文本情感分析[J]. 计算机应用, 2021, 41(10): 2829-2834.

YANG Shuxin, ZHANG Nan. Text sentiment analysis based on sentiment lexicon and context language model[J]. Journal of Computer Applications, 2021, 41(10): 2829-2834.

参考文献

[1] ZHU Z Y, DONG S J, YU C L, et al. A text hybrid clustering algorithm based on HowNet semantics[J]. Key Engineering Materials, 2011, 474/475/476:2071-2078.
[2] TABOADA M, BROOKE J, TOFILOSKI M, et al. Lexicon-based methods for sentiment analysis[J]. Computational Linguistics, 2011, 37(2):267-307.
[3] 李婷婷, 姬东鸿. 基于SVM和CRF多特征组合的微博情感分析[J]. 计算机应用研究, 2015, 32(4):978-981.(LI T T, JI D H. Sentiment analysis of micro-blog based on SVM and CRF using various combinations of features[J]. Application Research of Computers, 2015, 32(4):978-981.)
[4] PU X J, WU G S, YUAN C F. Exploring overall opinions for document level sentiment classification with structural SVM[J]. Multimedia Systems, 2019, 25(1):21-33.
[5] WANG X, LIU Y C, SUN C J, et al. Predicting polarities of tweets by composing word embeddings with long short-term memory[C]//Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics/the 7th International Joint Conference on Natural Language Processing. Stroudsburg, PA:Association for Computational Linguistics, 2015:1343-1353.
[6] KIM Y. Convolutional neural networks for sentence classification[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA:Association for Computational Linguistics, 2014:1746-1751.
[7] MIKOLOV T, CHEN K, CORRADO G, et al. Efficient estimation of word representations in vector space[EB/OL]. (2013-09-07)[2020-09-10]. https://arxiv.org/pdf/1301.3781.pdf.
[8] PENNINGTON J, SOCHER R, MANNING C D. GloVe:global vectors for word representation[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA:Association for Computational Linguistics, 2014:1532-1543.
[9] PALTOGLOU G, THELWALL M. Twitter, MySpace, Digg:unsupervised sentiment analysis in social media[J]. ACM Transactions on Intelligent Systems and Technology, 2012, 3(4):No. 66.
[10] QIU G, HE X F, ZHANG F, et al. DASA:dissatisfactionoriented advertising based on sentiment analysis[J]. Expert Systems with Applications, 2010, 37(9):6182-6191.
[11] JIANG L, YU M, ZHOU M, et al. Target-dependent twitter sentiment classification[C]//Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics:Human Language Technologies. Stroudsburg, PA:Association for Computational Linguistics, 2011:151-160.
[12] PANG B, LEE L, VAITHYANATHAN S. Thumbs up? Sentiment classification using machine learning[C]//Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA:Association for Computational Linguistics, 2002:79-86.
[13] TANG D Y, WEI F R, QIN B, et al. Coooolll:a deep learning system for twitter sentiment classification[C]//Proceedings of the 8th International Workshop on Semantic Evaluation. Stroudsburg, PA:Association for Computational Linguistics, 2014:208-212.
[14] HINTON G E, SALAKHUTDINOV R R. Reducing the dimensionality of data with neural networks[J]. Science, 2006, 313(5786):504-507.
[15] BENGIO Y, DUCHARME R, VINCENT P, et al. A neural probabilistic language model[J]. Journal of Machine Learning Research, 2003, 3:1137-1155.
[16] PETERS M E, NEUMANN M, IYYER M, et al. Deep contextualized word representations[C]//Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies. Stroudsburg, PA:Association for Computational Linguistics, 2018, 1:2227-2237.
[17] 赵亚欧, 张家重, 李贻斌, 等. 融合基于语言模型的词嵌入和多尺度卷积神经网络的情感分析[J]. 计算机应用, 2020, 40(3):651-657.(ZHAO Y O, ZHANG J Z, LI Y B, et al. Sentiment analysis using embedding from language model and multi-scale convolutional neural networks[J]. Journal of Computer Applications, 2020, 40(3):651-657.)
[18] 赵富, 杨洋, 蒋瑞, 等. 融合词性的双注意力Bi-LSTM情感分析[J]. 计算机应用, 2018, 38(S2):103-106, 147.(ZHAO F, YANG Y, JIANG R, et al. Sentiment analysis based on doubleattention Bi-LSTM using part-of-speech[J]. Journal of Computer Applications, 2018, 38(S2):103-106, 147.)
[19] 胡荣磊, 芮璐, 齐筱, 等. 基于循环神经网络和注意力模型的文本情感分析[J]. 计算机应用研究, 2019, 36(11):3282-3285. (HU R L, RUI L, QI X, et al. Text sentiment analysis based on recurrent neural networks and attention model[J]. Application Research of Computers, 2019, 36(11):3282-3285.)

融合情感词典与上下文语言模型的文本情感分析

Text sentiment analysis based on sentiment lexicon and context language model

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	宋中山, 梁家锐, 郑禄, 刘振宇, 帖军. 基于双向门控尺度特征融合的遥感场景分类[J]. 计算机应用, 2021, 41(9): 2726-2735.
[2]	李康康, 张静. 基于注意力机制的多层次编码和解码的图像描述模型[J]. 计算机应用, 2021, 41(9): 2504-2509.
[3]	张永斌, 常文欣, 孙连山, 张航. 基于字典的域名生成算法生成域名的检测方法[J]. 计算机应用, 2021, 41(9): 2609-2614.
[4]	赵宏, 孔东一. 图像特征注意力与自适应注意力融合的图像内容中文描述[J]. 计算机应用, 2021, 41(9): 2496-2503.
[5]	徐江浪, 李林燕, 万新军, 胡伏原. 结合目标检测的室内场景识别方法[J]. 计算机应用, 2021, 41(9): 2720-2725.
[6]	牟长宁, 王海鹏, 周丕宇, 侯鑫行. 基于图卷积神经网络的串联质谱从头测序[J]. 计算机应用, 2021, 41(9): 2773-2779.
[7]	王贺兵, 张春梅. 基于非对称卷积-压缩激发-次代残差网络的人脸关键点检测[J]. 计算机应用, 2021, 41(9): 2741-2747.
[8]	曾祥银, 郑伯川, 刘丹. 基于深度卷积神经网络和聚类的左右轨道线检测[J]. 计算机应用, 2021, 41(8): 2324-2329.
[9]	秦斌斌, 彭良康, 卢向明, 钱江波. 司机分心驾驶检测研究进展[J]. 计算机应用, 2021, 41(8): 2330-2337.
[10]	黄程程, 董霄霄, 李钊. 基于二维Winograd算法的深流水线5×5卷积方法[J]. 计算机应用, 2021, 41(8): 2258-2264.
[11]	曹玉红, 徐海, 刘荪傲, 王紫霄, 李宏亮. 基于深度学习的医学影像分割研究综述[J]. 计算机应用, 2021, 41(8): 2273-2287.
[12]	吴则举, 焦翠娟, 陈亮. 基于改进Faster R-CNN的轮胎缺陷检测方法[J]. 计算机应用, 2021, 41(7): 1939-1946.
[13]	杨粟, 欧阳智, 杜逆索. 基于相关度距离的无监督并行哈希图像检索[J]. 计算机应用, 2021, 41(7): 1902-1907.
[14]	武光利, 李雷霆, 郭振洲, 王成祥. 基于改进的双向长短期记忆网络的视频摘要生成模型[J]. 计算机应用, 2021, 41(7): 1908-1914.
[15]	谭道强, 曾诚, 乔金霞, 张俊. 基于混合注意力模型的阴影检测方法[J]. 计算机应用, 2021, 41(7): 2076-2081.