Aspect-based sentiment analysis model integrating match-LSTM network and grammatical distance

doi:10.11772/j.issn.1001-9081.2021111874

Journal of Computer Applications ›› 2023, Vol. 43 ›› Issue (1): 45-50.DOI: 10.11772/j.issn.1001-9081.2021111874

Special Issue: 人工智能

• Artificial intelligence • Previous Articles Next Articles

Aspect-based sentiment analysis model integrating match-LSTM network and grammatical distance

LIU Hui^1,2, MA Xiang^1,2, ZHANG Linyu^1,2, HE Rujin^1,2

1.School of Communication and Information Engineering， Chongqing University of Posts and Telecommunications， Chongqing 400065，China
2.Research Center of New Telecommunication Technology Applications， Chongqing University of Posts and Telecommunications， Chongqing 400065，China

Received:2021-11-05 Revised:2022-04-26 Online:2022-05-24
Contact: MA Xiang， born in 1994， M. S. candidate. His research interests include natural language processing， sentiment analysis.
About author:LIU Hui， born in 1966， M. S.， senior engineer. His research interests include natural language processing， multi-user detection algorithm， telecommunication system business；ZHANG Linyu， born in 1997， M. S. candidate. Her research interests include artificial intelligence， object detection ；HE Rujin， born in 1998， M. S. candidate. Her research interests include abnormal behavior detection；

融合匹配长短时记忆网络和语法距离的方面级情感分析模型

刘辉^1,2, 马祥^1,2, 张琳玉^1,2, 何如瑾^1,2

1.重庆邮电大学通信与信息工程学院，重庆 400065
2.重庆邮电大学通信新技术应用研究中心，重庆 400065

通讯作者: 马祥（1994—），男，安徽淮南人，硕士研究生，主要研究方向：自然语言处理、情感分析；842488692@qq.com
作者简介:刘辉（1966—），男，四川仪陇人，高级工程师，硕士，主要研究方向：自然语言处理、多用户检测算法、电信系统业务；张琳玉（1997—），女，河北石家庄人，硕士研究生，主要研究方向：人工智能、目标检测；何如瑾（1998—），女，湖南邵阳人，硕士研究生，主要研究方向：异常行为检测；

Abstract

Abstract: Aiming at the problems of the mismatch between aspect words and irrelevant context and the lack of grammatical level features in Aspect-Based Sentiment Analysis （ABSA） at current stage， an improved ABSA model integrating match-Long Short-Term Memory （mLSTM） and grammatical distances was proposed， namely mLSTM-GCN. Firstly， the correlation between the aspect word and the context was calculated word by word， and the obtained attention weight and the context representation were fused as the input of the mLSTM， so that the context representation with higher correlation with the aspect word was obtained. Then， the grammatical distance was introduced to obtain a context which was more grammatically related to the aspect word， so as to obtain more contextual features to guide the modeling of the aspect word， and obtain the aspect representation through the aspect masking layer. Finally， in order to exchange information， location weights， context representations and aspect representations were combined， thereby obtaining the features for sentiment analysis. Experimental results on Twitter， REST14 and LAP14 datasets show that compared with Aspect-Specific Graph Convolutional Network （ASGCN）， mLSTM-GCN has the accuracy improved by 1.32， 2.50 and 1.63 percentage points， respectively， and has the Macro-F1 score improved by 2.52， 2.19 and 1.64 percentage points， respectively. Therefore， mLSTM-GCN can effectively reduce the probability of mismatch between aspect words and irrelevant context， and improve the classification effect.

Key words: Aspect-Based Sentiment Analysis (ABSA), Long Short-Term Memory (LSTM) network, grammatical distance, graph convolution, attention mechanism

摘要： 针对现阶段方面级情感分析（ABSA）存在的方面词与不相关上下文错误匹配以及缺乏语法层面特征的问题，提出一种融合匹配长短时记忆网络（mLSTM）和语法距离的ABSA模型mLSTM-GCN。首先，逐词计算方面词与上下文的关联性，并将得到的注意力权重与上下文表示融合作为mLSTM的输入，从而得到与方面词关联度更高的上下文表示；然后，引入语法距离以获得与方面词语法关联度更高的上下文，从而获取更多的上下文特征来指导方面词的建模，并通过方面掩盖层得到方面表示；最后，结合位置权重、上下文表示以及方面表示来进行信息交互，从而获取用于情感分析的特征。在Twitter、REST14和LAP14数据集上的实验结果表明，相较于特定方面的图卷积网络（ASGCN），mLSTM-GCN的准确率分别提升1.32、2.50和1.63个百分点，宏平均F1分别提升2.52、2.19和1.64个百分点。可见，mLSTM-GCN能够有效降低方面词与不相关上下文错误匹配的概率，提升分类效果。

关键词: 方面级情感分析, 长短时记忆网络, 语法距离, 图卷积, 注意力机制

CLC Number:

TP391.1

LIU Hui, MA Xiang, ZHANG Linyu, HE Rujin. Aspect-based sentiment analysis model integrating match-LSTM network and grammatical distance[J]. Journal of Computer Applications, 2023, 43(1): 45-50.

刘辉, 马祥, 张琳玉, 何如瑾. 融合匹配长短时记忆网络和语法距离的方面级情感分析模型[J]. 《计算机应用》唯一官方网站, 2023, 43(1): 45-50.

References

1 黄萱菁，赵军.中文文本情感倾向性分析［J］.中国计算机学会通讯，2008，4（2）：39-47. HUANG X J，ZHAO J. Chinese text sentiment opinion analysis ［J］. Communications of the China Computer Federation，2008，4（2）：39-47.
2 JIANG L， YU M， ZHOU M， et al. Target-dependent twitter sentiment classification［C］// Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics： Human Language Technologies. Stroudsburg， PA： Association for Computational Linguistics， 2011：151-160.
3 KIRITCHENKO S， ZHU X， CHERRY C， et al. NRC-Canada-2014： Detecting aspects and sentiment in customer reviews［C］//Proceedings of the 8th International Workshop on Semantic Evaluation. Stroudsburg， PA： Association for Computational Linguistics， 2014： 437-442. 10.3115/v1/s14-2076
4 BAHDANAU D， CHO K， BENGIO Y. Neural machine translation by jointly learning to align and translate［EB/OL］. （2016-05-19）［2021-08-10］.https：//arxiv.org/pdf/1409.0473.pdf. 10.1017/9781108608480.003
5 SONG M ， PARK H ， SHIN K S . Attention-based long short-term memory network using sentiment lexicon embedding for aspect-level sentiment analysis in Korean［J］. Information Processing and Management， 2019， 56（3）：637-653. 10.1016/j.ipm.2018.12.005
6 TANG D Y， QIN B， FENG X C， et al. Effective LSTMs for target-dependent sentiment classification［C］// Proceedings of the 26th International Conference on Computational Linguistics： Technical Papers. ［S.l.］： The COLING 2016 Organizing Committee， 2016：3298-3307.
7 RUDER S， GHAFFARI P， BRESLIN J G. A hierarchical model of reviews for aspect-based sentiment analysis ［C］// Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Stroudsburg， PA： Association for Computational Linguistics， 2016：999-1005. 10.18653/v1/d16-1103
8 LI X， BING L D， LAM W， et al. Transformation networks for target-oriented sentiment classification ［C］// Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics. Stroudsburg， PA： Association for Computational Linguistics， 2018，1： 946-956. 10.18653/v1/p18-1087
9 WANG Y， HUANG M， ZHU X， et al. Attention-based LSTM for aspect-level sentiment classification［C］// Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Stroudsburg， PA： Association for Computational Linguistics， 2016： 606-615. 10.18653/v1/d16-1058
10 XU M，ZENG B，YANG H， et al. Combining dynamic local context focus and dependency cluster attention for aspect-level sentiment classification ［J］.Neurocomputing，2022，478：49-69. 10.1016/j.neucom.2021.12.084
11 BASIRI M E， NEMATI S， ABDAR M， et al. ABCDM： An attention-based bidirectional CNN-RNN deep model for sentiment analysis［J］. Future Generation Computer Systems， 2021， 115： 279-294. 10.1016/j.future.2020.08.005
12 TANG D， QIN B， LIU T. Aspect level sentiment classification with deep memory network ［C］// Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Stroudsburg， PA： Association for Computational Linguistics， 2016：214-224. 10.18653/v1/d16-1021
13 MA D H， LI S J， ZHANG X D， et al. Interactive attention networks for aspect-level sentiment classification［C］// Proceedings of the 26th International Joint Conference on Artificial Intelligence. California： ijcai.org， 2017：4068-4074. 10.24963/ijcai.2017/568
14 HUANG B， OU Y， CARLEY K M. Aspect level sentiment classification with attention-over-attention neural networks［C］//Proceedings of the 2018 International Conference on Social Computing， Behavioral-Cultural Modeling and Prediction and Behavior Representation in Modeling and Simulation LNCS 10899. Cham： Springer， 2018： 197-206. 10.1007/978-3-319-93372-6_22
15 ZHOU J， HUANG J X， HU Q V， et al. SK-GCN： modeling syntax and knowledge via graph convolutional network for aspect-level sentiment classification［J］. Knowledge-Based Systems， 2020， 205： No.106292. 10.1016/j.knosys.2020.106292
16 ZHU X， ZHU L， GUO J， et al. GL-GCN： Global and local dependency guided graph convolutional networks for aspect-based sentiment classification［J］.Expert Systems with Applications，2021，186： No.115712. 10.1016/j.eswa.2021.115712
17 ZHANG C， LI Q， SONG D. Aspect-based sentiment classification with aspect-specific graph convolutional networks［C］// Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. Stroudsburg， PA： Association for Computational Linguistics， 2019：4568-4578. 10.18653/v1/d19-1464
18 WANG S， JIANG J . Learning natural language inference with LSTM［C］// Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics： Human Language Technologies. Stroudsburg， PA： Association for Computational Linguistics， 2016：1442-1451. 10.18653/v1/n16-1170
19 苏锦钿，欧阳志凡，余珊珊.基于依存树及距离注意力的句子属性情感分类［J］.计算机研究与发展，2019，56（8）：1731-1745. 10.7544/issn1000-1239.2019.20190102 SU J D，OUYANG Z F，YU S S. Aspect-level sentiment classification for sentences based on dependency tree and distance attention［J］. Journal of Computer Research and Development， 2019， 56（8）：1731-1745. 10.7544/issn1000-1239.2019.20190102
20 ZHANG M， QIAN T. Convolution over hierarchical syntactic and lexical graphs for aspect level sentiment analysis［C］// Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. Stroudsburg， PA： Association for Computational Linguistics， 2020：3540-3549. 10.18653/v1/2020.emnlp-main.286
21 CHEN C， TENG Z， ZHANG Y. Inducing target-specific latent structures for aspect sentiment classification［C］// Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. Stroudsburg， PA： Association for Computational Linguistics， 2020：5596-5607. 10.18653/v1/2020.emnlp-main.451

[1]	Chuanlin PANG, Rui TANG, Ruizhi ZHANG, Chuan LIU, Jia LIU, Shibo YUE. Distributed power allocation algorithm based on graph convolutional network for D2D communication systems [J]. Journal of Computer Applications, 2024, 44(9): 2855-2862.
[2]	Guixiang XUE, Hui WANG, Weifeng ZHOU, Yu LIU, Yan LI. Port traffic flow prediction based on knowledge graph and spatio-temporal diffusion graph convolutional network [J]. Journal of Computer Applications, 2024, 44(9): 2952-2957.
[3]	Zhiqiang ZHAO, Peihong MA, Xinhong HEI. Crowd counting method based on dual attention mechanism [J]. Journal of Computer Applications, 2024, 44(9): 2886-2892.
[4]	Jing QIN, Zhiguang QIN, Fali LI, Yueheng PENG. Diagnosis of major depressive disorder based on probabilistic sparse self-attention neural network [J]. Journal of Computer Applications, 2024, 44(9): 2970-2974.
[5]	Liting LI, Bei HUA, Ruozhou HE, Kuang XU. Multivariate time series prediction model based on decoupled attention mechanism [J]. Journal of Computer Applications, 2024, 44(9): 2732-2738.
[6]	Chunxue ZHANG, Liqing QIU, Cheng’ai SUN, Caixia JING. Purchase behavior prediction model based on two-stage dynamic interest recognition [J]. Journal of Computer Applications, 2024, 44(8): 2365-2371.
[7]	Kaipeng XUE, Tao XU, Chunjie LIAO. Multimodal sentiment analysis network with self-supervision and multi-layer cross attention [J]. Journal of Computer Applications, 2024, 44(8): 2387-2392.
[8]	Pengqi GAO, Heming HUANG, Yonghong FAN. Fusion of coordinate and multi-head attention mechanisms for interactive speech emotion recognition [J]. Journal of Computer Applications, 2024, 44(8): 2400-2406.
[9]	Yuhan LIU, Genlin JI, Hongping ZHANG. Video pedestrian anomaly detection method based on skeleton graph and mixed attention [J]. Journal of Computer Applications, 2024, 44(8): 2551-2557.
[10]	Zhonghua LI, Yunqi BAI, Xuejin WANG, Leilei HUANG, Chujun LIN, Shiyu LIAO. Low illumination face detection based on image enhancement [J]. Journal of Computer Applications, 2024, 44(8): 2588-2594.
[11]	Shangbin MO, Wenjun WANG, Ling DONG, Shengxiang GAO, Zhengtao YU. Single-channel speech enhancement based on multi-channel information aggregation and collaborative decoding [J]. Journal of Computer Applications, 2024, 44(8): 2611-2617.
[12]	Li LIU, Haijin HOU, Anhong WANG, Tao ZHANG. Generative data hiding algorithm based on multi-scale attention [J]. Journal of Computer Applications, 2024, 44(7): 2102-2109.
[13]	Song XU, Wenbo ZHANG, Yifan WANG. Lightweight video salient object detection network based on spatiotemporal information [J]. Journal of Computer Applications, 2024, 44(7): 2192-2199.
[14]	Dahai LI, Zhonghua WANG, Zhendong WANG. Dual-branch low-light image enhancement network combining spatial and frequency domain information [J]. Journal of Computer Applications, 2024, 44(7): 2175-2182.
[15]	Wenliang WEI, Yangping WANG, Biao YUE, Anzheng WANG, Zhe ZHANG. Deep learning model for infrared and visible image fusion based on illumination weight allocation and attention [J]. Journal of Computer Applications, 2024, 44(7): 2183-2191.

Aspect-based sentiment analysis model integrating match-LSTM network and grammatical distance

融合匹配长短时记忆网络和语法距离的方面级情感分析模型

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics