基于门控机制和卷积神经网络的中文文本情感分析模型

doi:10.11772/j.issn.1001-9081.2020122043

计算机应用 ›› 2021, Vol. 41 ›› Issue (10): 2842-2848.DOI: 10.11772/j.issn.1001-9081.2020122043

所属专题：人工智能

基于门控机制和卷积神经网络的中文文本情感分析模型

杨璐, 何明祥

山东科技大学计算机科学与工程学院, 山东青岛266590

收稿日期:2020-12-28 修回日期:2021-04-25 出版日期:2021-10-10 发布日期:2021-07-14
通讯作者: 何明祥
作者简介:杨璐(1995-),女,山东菏泽人,硕士研究生,CCF会员,主要研究方向:文本情感分析、深度学习;何明祥(1969-),男,安徽合肥人,副教授,博士,主要研究方向:数据库系统、信息处理、人工智能。
基金资助:
2020年度青岛市社会科学规划研究项目（QDSKL2001143）。

Chinese text sentiment analysis model based on gated mechanism and convolutional neural network

YANG Lu, HE Mingxiang

College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao Shandong 266590, China

Received:2020-12-28 Revised:2021-04-25 Online:2021-10-10 Published:2021-07-14
Supported by:
This work is partially supported by the Research Project of 2020 Qingdao Social Sciences Plan (QDSKL2001143).

摘要/Abstract

摘要： 针对中文数据的特殊性导致判别时容易产生噪声信息，使用传统卷积神经网络（CNN）无法深度挖掘情感特征信息等问题，提出了一种结合情感词典的双输入通道门控卷积神经网络（DC-GCNN-SL）模型。首先，使用情感词典的词语情感分数对句子中的词语进行标记，从而使网络获取情感先验知识，并在训练过程中有效地去除了输入句子的噪声信息；然后，在捕获句子深度情感特征时，提出了基于GTRU的门控机制，并通过两个输入通道的文本卷积运算实现两种特征的融合，控制信息传递，有效地得到了更丰富的隐藏信息；最后，通过softmax函数输出文本情感极性。在酒店评论数据集、外卖评论数据集和商品评论数据集上进行了实验。实验结果表明，与文本情感分析的其他模型相比，所提模型具有更好的准确率、精确率、召回率和F1值，能够有效地获取句子的情感特征。

关键词: 自然语言处理, 文本情感分析, 情感词典, 卷积神经网络, 门控机制

Abstract: The particularity of Chinese data leads to noise information generation in the process of discrimination, and the traditional Convolutional Neural Network (CNN) cannot deeply mine emotional feature information. In order to solve the problems, a Dual Channel Gated Convolutional Neural Network model with Sentiment Lexicon (DC-GCNN-SL) was proposed. Firstly, the word sentiment score of sentiment lexicon was used to mark the words in the sentences, so that the prior knowledge of emotion was obtained by the network, and the noise information of the input sentence was effectively removed in the training process. Secondly, a gated mechanism based on GTRU (Gated Tanh-ReLU Unit) was proposed while capturing the deep sentiment features of the sentences, and the text convolution operation of the two input channels was used to fuse the two features, control the information transmission, and obtain more abundant hidden information effectively. Finally, the text sentiment polarity was output through the softmax function. The experiments were carried out on hotel review dataset, takeaway review dataset and commodity review dataset. Experimental results show that, compared with other models of text sentiment analysis, the proposed model has better accuracy, precision, recall and F1-score, and can effectively obtain the emotional features of sentences.

Key words: Natural Language Processing (NLP), text sentiment analysis, sentiment lexicon, Convolutional Neural Network (CNN), gated mechanism

中图分类号:

TP391.1

杨璐, 何明祥. 基于门控机制和卷积神经网络的中文文本情感分析模型[J]. 计算机应用, 2021, 41(10): 2842-2848.

YANG Lu, HE Mingxiang. Chinese text sentiment analysis model based on gated mechanism and convolutional neural network[J]. Journal of Computer Applications, 2021, 41(10): 2842-2848.

参考文献

[1] LIU B, ZHANG L. A survey of opinion mining and sentiment analysis[M]//AGGARWAL C C, ZHAI C X. Mining Text Data. Boston:Springer, 2012:415-463.
[2] PANG B, LEE L, VAITHYANATHAN S. Thumbs up? Sentiment classification using machine learning techniques[C]//Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA:Association for Computational Linguistics, 2002:79-86.
[3] 李平, 戴月明, 王艳. 基于混合卡方统计量与逻辑回归的文本情感分析[J]. 计算机工程, 2017, 43(12):192-196, 202.(LI P, DAI Y M, WANG Y. Text sentiment analysis based on hybrid Chisquare statistic and logistic regression[J]. Computer Engineering, 2017, 43(12):192-196, 202.)
[4] 杨超, 冯时, 王大玲, 等. 基于情感词典扩展技术的网络舆情倾向性分析[J]. 小型微型计算机系统, 2010, 31(4):691-695. (YANG C, FENG S, WANG D L, et al. Analysis on web public opinion orientation based on extending sentiment lexicon[J]. Journal of Chinese Computer Systems, 2010, 31(4):691-995.)
[5] 周咏梅, 杨佳能, 阳爱民. 面向文本情感分析的中文情感词典构建方法[J]. 山东大学学报(工学版), 2013, 43(6):27-33. (ZHOU Y M, YANG J N, YANG A M. A method on building Chinese sentiment lexicon for text sentiment analysis[J]. Journal of Shandong University (Engineering Science), 2013, 43(6):27-33.)
[6] 欧阳继红, 刘燕辉, 李熙铭, 等. 基于LDA的多粒度主题情感混合模型[J]. 电子学报, 2015, 43(9):1875-1880.(OUYANG J H, LIU Y H, LI X M, et al. Multi-grain sentiment/topic model based on LDA[J]. Acta Electronica Sinica, 2015, 43(9):1875-1880.)
[7] YOUNG T, HAZARIKA D, PORIA S, et al. Recent trends in deep learning based natural language processing[review article] [J]. IEEE Computational Intelligence Magazine, 2018, 13(3):55-75.
[8] KIM Y. Convolutional neural networks for sentence classification[C]//Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA:Association for Computational Linguistics, 2014:1746-1751.
[9] TANG D Y, QIN B, LIU T. Aspect level sentiment classification with deep memory network[C]//Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA:Association for Computational Linguistics, 2016:214-224.
[10] 梁斌, 刘全, 徐进, 等. 基于多注意力卷积神经网络的特定目标情感分析[J]. 计算机研究与发展, 2017, 54(8):1724-1735. (LIANG B, LIU Q, XU J, et al. Aspect-based sentiment analysis based on multi-attention CNN[J]. Journal of Computer Research and Development, 2017, 54(8):1724-1735.)
[11] LUO W J, LI Y J, URTASUN R, et al. Understanding the effective receptive field in deep convolutional neural networks[C]//Proceedings of the 30th International Conference on Neural Information Processing Systems. Red Hook, NY:Curran Associates Inc., 2016:4905-4913.
[12] 李平, 戴月明, 吴定会. 双通道卷积神经网络在文本情感分析中的应用[J]. 计算机应用, 2018, 38(6):1542-1546.(LI P, DAI Y M, WU D H. Application of dual-channel convolutional neural network in sentiment analysis[J]. Journal of Computer Applications, 2018, 38(6):1542-1546.)
[13] 赵宏, 王乐, 王伟杰. 基于BiLSTM-CNN串行混合模型的文本情感分析[J]. 计算机应用, 2020, 40(1):16-22.(ZHAO H, WANG L, WANG W J. Text sentiment analysis based on serial hybrid model of bi-directional long short-term memory and convolutional neural network[J]. Journal of Computer Applications, 2020, 40(1):16-22.)
[14] 蔡国永, 夏彬彬. 基于卷积神经网络的图文融合媒体情感预测[J]. 计算机应用, 2016, 36(2):428-431, 477.(CAI G Y, XIA B B. Multimedia sentiment analysis based on convolutional neural network[J]. Journal of Computer Applications, 2016, 36(2):428-431, 477.)
[15] DAUPHIN Y N, FAN A, AULI M, et al. Language modeling with gated convolutional networks[C]//Proceedings of the 34th International Conference on Machine Learning. New York:JMLR. org, 2017:933-941.
[16] 柳杨, 吉立新, 黄瑞阳, 等. 基于门控卷积机制与层次注意力机制的多语义词向量计算方法[J]. 中文信息学报, 2018, 32(7):1-10, 19.(LIU Y, JI L X, HUANG R Y, et al. A multisense word embedding method based on gated convolution and hierarchical attention mechanism[J]. Journal of Chinese Information Processing, 2018, 32(7):1-10, 19.)
[17] XUE W, LI T. Aspect based sentiment analysis with gated convolutional networks[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA:Association for Computational Linguistics, 2018, 1:2514-2523.
[18] 李兴亚, 陈钰枫, 徐金安, 等. 融合门控机制的远程监督关系抽取方法[J]. 北京大学学报(自然科学版), 2020, 56(1):39-44. (LI X Y, CHEN Y F, XU J A, et al. Distant supervision for relation extraction with gate mechanism[J]. Acta Scientiarum Naturalium Universitatis Pekinensis, 2020, 56(1):39-44.)
[19] MIKOLOV T, CHEN K, CORRADO G, et al. Efficient estimation of word representations in vector space[EB/OL]. (2013-09-07)[2020-11-12]. https://arxiv.org/pdf/1301.3781.pdf.
[20] 朱烨, 陈世平. 融合卷积神经网络和注意力的评论文本情感分析[J]. 小型微型计算机系统, 2020, 41(3):551-557.(ZHU Y, CHEN S P. Commentary text sentiment analysis combining convolution neural network and attention[J]. Journal of Chinese Computer Systems, 2020, 41(3):551-557.)
[21] LAI S W, XU L H, LIU K, et al. Recurrent convolutional neural networks for text classification[C]//Proceedings of the 29th AAAI Conference on Artificial Intelligence. Palo Alto, CA:AAAI Press, 2015:2267-2273.
[22] BAKTHA K, TRIPATHY B K. Investigation of recurrent neural networks in the field of sentiment analysis[C]//Proceedings of the 2017 International Conference on Communication and Signal Processing. Piscataway:IEEE, 2017:2047-2050.
[23] BASNET A, TIMALSINA A K. Improving Nepali news recommendation using classification based on LSTM recurrent neural networks[C]//Proceedings of the IEEE 3rd International Conference on Computing, Communication and Security. Piscataway:IEEE, 2018:138-142.
[24] AZIZ SHARFUDDIN A, NAFIS TIHAMI M, SAIFUL ISLAM M. A deep recurrent neural network with BiLSTM model for sentiment classification[C]//Proceedings of the 2018 International Conference on Bangla Speech and Language Processing. Piscataway:IEEE, 2018:1-4.

基于门控机制和卷积神经网络的中文文本情感分析模型

Chinese text sentiment analysis model based on gated mechanism and convolutional neural network

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	王贺兵, 张春梅. 基于非对称卷积-压缩激发-次代残差网络的人脸关键点检测[J]. 计算机应用, 2021, 41(9): 2741-2747.
[2]	宋中山, 梁家锐, 郑禄, 刘振宇, 帖军. 基于双向门控尺度特征融合的遥感场景分类[J]. 计算机应用, 2021, 41(9): 2726-2735.
[3]	李康康, 张静. 基于注意力机制的多层次编码和解码的图像描述模型[J]. 计算机应用, 2021, 41(9): 2504-2509.
[4]	张永斌, 常文欣, 孙连山, 张航. 基于字典的域名生成算法生成域名的检测方法[J]. 计算机应用, 2021, 41(9): 2609-2614.
[5]	赵宏, 孔东一. 图像特征注意力与自适应注意力融合的图像内容中文描述[J]. 计算机应用, 2021, 41(9): 2496-2503.
[6]	徐江浪, 李林燕, 万新军, 胡伏原. 结合目标检测的室内场景识别方法[J]. 计算机应用, 2021, 41(9): 2720-2725.
[7]	牟长宁, 王海鹏, 周丕宇, 侯鑫行. 基于图卷积神经网络的串联质谱从头测序[J]. 计算机应用, 2021, 41(9): 2773-2779.
[8]	谢德峰, 吉建民. 融入句法感知表示进行句法增强的语义解析[J]. 计算机应用, 2021, 41(9): 2489-2495.
[9]	刘雅璇, 钟勇. 基于头实体注意力的实体关系联合抽取方法[J]. 计算机应用, 2021, 41(9): 2517-2522.
[10]	曹玉红, 徐海, 刘荪傲, 王紫霄, 李宏亮. 基于深度学习的医学影像分割研究综述[J]. 计算机应用, 2021, 41(8): 2273-2287.
[11]	秦斌斌, 彭良康, 卢向明, 钱江波. 司机分心驾驶检测研究进展[J]. 计算机应用, 2021, 41(8): 2330-2337.
[12]	黄程程, 董霄霄, 李钊. 基于二维Winograd算法的深流水线5×5卷积方法[J]. 计算机应用, 2021, 41(8): 2258-2264.
[13]	周险兵, 樊小超, 任鸽, 杨勇. 基于多层次语义特征的英文作文自动评分方法[J]. 计算机应用, 2021, 41(8): 2205-2211.
[14]	曾祥银, 郑伯川, 刘丹. 基于深度卷积神经网络和聚类的左右轨道线检测[J]. 计算机应用, 2021, 41(8): 2324-2329.
[15]	谭道强, 曾诚, 乔金霞, 张俊. 基于混合注意力模型的阴影检测方法[J]. 计算机应用, 2021, 41(7): 2076-2081.