融合匹配长短时记忆网络和语法距离的方面级情感分析模型

doi:10.11772/j.issn.1001-9081.2021111874

《计算机应用》唯一官方网站 ›› 2023, Vol. 43 ›› Issue (1): 45-50.DOI: 10.11772/j.issn.1001-9081.2021111874

所属专题：人工智能

融合匹配长短时记忆网络和语法距离的方面级情感分析模型

刘辉^1,2, 马祥^1,2, 张琳玉^1,2, 何如瑾^1,2

1.重庆邮电大学通信与信息工程学院，重庆 400065
2.重庆邮电大学通信新技术应用研究中心，重庆 400065

收稿日期:2021-11-05 修回日期:2022-04-26 发布日期:2022-05-24
通讯作者: 马祥（1994—），男，安徽淮南人，硕士研究生，主要研究方向：自然语言处理、情感分析；842488692@qq.com
作者简介:刘辉（1966—），男，四川仪陇人，高级工程师，硕士，主要研究方向：自然语言处理、多用户检测算法、电信系统业务；张琳玉（1997—），女，河北石家庄人，硕士研究生，主要研究方向：人工智能、目标检测；何如瑾（1998—），女，湖南邵阳人，硕士研究生，主要研究方向：异常行为检测；

Aspect-based sentiment analysis model integrating match-LSTM network and grammatical distance

LIU Hui^1,2, MA Xiang^1,2, ZHANG Linyu^1,2, HE Rujin^1,2

1.School of Communication and Information Engineering， Chongqing University of Posts and Telecommunications， Chongqing 400065，China
2.Research Center of New Telecommunication Technology Applications， Chongqing University of Posts and Telecommunications， Chongqing 400065，China

Received:2021-11-05 Revised:2022-04-26 Online:2022-05-24
Contact: MA Xiang， born in 1994， M. S. candidate. His research interests include natural language processing， sentiment analysis.
About author:LIU Hui， born in 1966， M. S.， senior engineer. His research interests include natural language processing， multi-user detection algorithm， telecommunication system business；ZHANG Linyu， born in 1997， M. S. candidate. Her research interests include artificial intelligence， object detection ；HE Rujin， born in 1998， M. S. candidate. Her research interests include abnormal behavior detection；

摘要/Abstract

摘要： 针对现阶段方面级情感分析（ABSA）存在的方面词与不相关上下文错误匹配以及缺乏语法层面特征的问题，提出一种融合匹配长短时记忆网络（mLSTM）和语法距离的ABSA模型mLSTM-GCN。首先，逐词计算方面词与上下文的关联性，并将得到的注意力权重与上下文表示融合作为mLSTM的输入，从而得到与方面词关联度更高的上下文表示；然后，引入语法距离以获得与方面词语法关联度更高的上下文，从而获取更多的上下文特征来指导方面词的建模，并通过方面掩盖层得到方面表示；最后，结合位置权重、上下文表示以及方面表示来进行信息交互，从而获取用于情感分析的特征。在Twitter、REST14和LAP14数据集上的实验结果表明，相较于特定方面的图卷积网络（ASGCN），mLSTM-GCN的准确率分别提升1.32、2.50和1.63个百分点，宏平均F1分别提升2.52、2.19和1.64个百分点。可见，mLSTM-GCN能够有效降低方面词与不相关上下文错误匹配的概率，提升分类效果。

关键词: 方面级情感分析, 长短时记忆网络, 语法距离, 图卷积, 注意力机制

Abstract: Aiming at the problems of the mismatch between aspect words and irrelevant context and the lack of grammatical level features in Aspect-Based Sentiment Analysis （ABSA） at current stage， an improved ABSA model integrating match-Long Short-Term Memory （mLSTM） and grammatical distances was proposed， namely mLSTM-GCN. Firstly， the correlation between the aspect word and the context was calculated word by word， and the obtained attention weight and the context representation were fused as the input of the mLSTM， so that the context representation with higher correlation with the aspect word was obtained. Then， the grammatical distance was introduced to obtain a context which was more grammatically related to the aspect word， so as to obtain more contextual features to guide the modeling of the aspect word， and obtain the aspect representation through the aspect masking layer. Finally， in order to exchange information， location weights， context representations and aspect representations were combined， thereby obtaining the features for sentiment analysis. Experimental results on Twitter， REST14 and LAP14 datasets show that compared with Aspect-Specific Graph Convolutional Network （ASGCN）， mLSTM-GCN has the accuracy improved by 1.32， 2.50 and 1.63 percentage points， respectively， and has the Macro-F1 score improved by 2.52， 2.19 and 1.64 percentage points， respectively. Therefore， mLSTM-GCN can effectively reduce the probability of mismatch between aspect words and irrelevant context， and improve the classification effect.

Key words: Aspect-Based Sentiment Analysis (ABSA), Long Short-Term Memory (LSTM) network, grammatical distance, graph convolution, attention mechanism

中图分类号:

TP391.1

刘辉, 马祥, 张琳玉, 何如瑾. 融合匹配长短时记忆网络和语法距离的方面级情感分析模型[J]. 计算机应用, 2023, 43(1): 45-50.

LIU Hui, MA Xiang, ZHANG Linyu, HE Rujin. Aspect-based sentiment analysis model integrating match-LSTM network and grammatical distance[J]. Journal of Computer Applications, 2023, 43(1): 45-50.

参考文献

1 黄萱菁，赵军.中文文本情感倾向性分析［J］.中国计算机学会通讯，2008，4（2）：39-47. HUANG X J，ZHAO J. Chinese text sentiment opinion analysis ［J］. Communications of the China Computer Federation，2008，4（2）：39-47.
2 JIANG L， YU M， ZHOU M， et al. Target-dependent twitter sentiment classification［C］// Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics： Human Language Technologies. Stroudsburg， PA： Association for Computational Linguistics， 2011：151-160.
3 KIRITCHENKO S， ZHU X， CHERRY C， et al. NRC-Canada-2014： Detecting aspects and sentiment in customer reviews［C］//Proceedings of the 8th International Workshop on Semantic Evaluation. Stroudsburg， PA： Association for Computational Linguistics， 2014： 437-442. 10.3115/v1/s14-2076
4 BAHDANAU D， CHO K， BENGIO Y. Neural machine translation by jointly learning to align and translate［EB/OL］. （2016-05-19）［2021-08-10］.https：//arxiv.org/pdf/1409.0473.pdf. 10.1017/9781108608480.003
5 SONG M ， PARK H ， SHIN K S . Attention-based long short-term memory network using sentiment lexicon embedding for aspect-level sentiment analysis in Korean［J］. Information Processing and Management， 2019， 56（3）：637-653. 10.1016/j.ipm.2018.12.005
6 TANG D Y， QIN B， FENG X C， et al. Effective LSTMs for target-dependent sentiment classification［C］// Proceedings of the 26th International Conference on Computational Linguistics： Technical Papers. ［S.l.］： The COLING 2016 Organizing Committee， 2016：3298-3307.
7 RUDER S， GHAFFARI P， BRESLIN J G. A hierarchical model of reviews for aspect-based sentiment analysis ［C］// Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Stroudsburg， PA： Association for Computational Linguistics， 2016：999-1005. 10.18653/v1/d16-1103
8 LI X， BING L D， LAM W， et al. Transformation networks for target-oriented sentiment classification ［C］// Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics. Stroudsburg， PA： Association for Computational Linguistics， 2018，1： 946-956. 10.18653/v1/p18-1087
9 WANG Y， HUANG M， ZHU X， et al. Attention-based LSTM for aspect-level sentiment classification［C］// Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Stroudsburg， PA： Association for Computational Linguistics， 2016： 606-615. 10.18653/v1/d16-1058
10 XU M，ZENG B，YANG H， et al. Combining dynamic local context focus and dependency cluster attention for aspect-level sentiment classification ［J］.Neurocomputing，2022，478：49-69. 10.1016/j.neucom.2021.12.084
11 BASIRI M E， NEMATI S， ABDAR M， et al. ABCDM： An attention-based bidirectional CNN-RNN deep model for sentiment analysis［J］. Future Generation Computer Systems， 2021， 115： 279-294. 10.1016/j.future.2020.08.005
12 TANG D， QIN B， LIU T. Aspect level sentiment classification with deep memory network ［C］// Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing. Stroudsburg， PA： Association for Computational Linguistics， 2016：214-224. 10.18653/v1/d16-1021
13 MA D H， LI S J， ZHANG X D， et al. Interactive attention networks for aspect-level sentiment classification［C］// Proceedings of the 26th International Joint Conference on Artificial Intelligence. California： ijcai.org， 2017：4068-4074. 10.24963/ijcai.2017/568
14 HUANG B， OU Y， CARLEY K M. Aspect level sentiment classification with attention-over-attention neural networks［C］//Proceedings of the 2018 International Conference on Social Computing， Behavioral-Cultural Modeling and Prediction and Behavior Representation in Modeling and Simulation LNCS 10899. Cham： Springer， 2018： 197-206. 10.1007/978-3-319-93372-6_22
15 ZHOU J， HUANG J X， HU Q V， et al. SK-GCN： modeling syntax and knowledge via graph convolutional network for aspect-level sentiment classification［J］. Knowledge-Based Systems， 2020， 205： No.106292. 10.1016/j.knosys.2020.106292
16 ZHU X， ZHU L， GUO J， et al. GL-GCN： Global and local dependency guided graph convolutional networks for aspect-based sentiment classification［J］.Expert Systems with Applications，2021，186： No.115712. 10.1016/j.eswa.2021.115712
17 ZHANG C， LI Q， SONG D. Aspect-based sentiment classification with aspect-specific graph convolutional networks［C］// Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing. Stroudsburg， PA： Association for Computational Linguistics， 2019：4568-4578. 10.18653/v1/d19-1464
18 WANG S， JIANG J . Learning natural language inference with LSTM［C］// Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics： Human Language Technologies. Stroudsburg， PA： Association for Computational Linguistics， 2016：1442-1451. 10.18653/v1/n16-1170
19 苏锦钿，欧阳志凡，余珊珊.基于依存树及距离注意力的句子属性情感分类［J］.计算机研究与发展，2019，56（8）：1731-1745. 10.7544/issn1000-1239.2019.20190102 SU J D，OUYANG Z F，YU S S. Aspect-level sentiment classification for sentences based on dependency tree and distance attention［J］. Journal of Computer Research and Development， 2019， 56（8）：1731-1745. 10.7544/issn1000-1239.2019.20190102
20 ZHANG M， QIAN T. Convolution over hierarchical syntactic and lexical graphs for aspect level sentiment analysis［C］// Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. Stroudsburg， PA： Association for Computational Linguistics， 2020：3540-3549. 10.18653/v1/2020.emnlp-main.286
21 CHEN C， TENG Z， ZHANG Y. Inducing target-specific latent structures for aspect sentiment classification［C］// Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. Stroudsburg， PA： Association for Computational Linguistics， 2020：5596-5607. 10.18653/v1/2020.emnlp-main.451

[1]	王静红, 周志霞, 王辉, 李昊康. 双路自编码器的属性网络表示学习[J]. 《计算机应用》唯一官方网站, 2023, 43(8): 2338-2344.
[2]	段升位, 程欣宇, 王浩舟, 王飞. 基于改进的YOLOv5的大坝表面病害检测算法[J]. 《计算机应用》唯一官方网站, 2023, 43(8): 2619-2629.
[3]	刘源, 董永权, 贾瑞, 杨昊霖. 面向个性化课程推荐的分层分期注意力网络模型[J]. 《计算机应用》唯一官方网站, 2023, 43(8): 2358-2363.
[4]	梁美佳, 刘昕武, 胡晓鹏. 基于改进YOLOv3的列车运行环境图像小目标检测算法[J]. 《计算机应用》唯一官方网站, 2023, 43(8): 2611-2618.
[5]	衡红军, 杨鼎诚. 知识增强的方面词交互图神经网络[J]. 《计算机应用》唯一官方网站, 2023, 43(8): 2412-2419.
[6]	崔雨萌, 王靖亚, 刘晓文, 闫尚义, 陶知众. 融合注意力和裁剪机制的通用文本分类模型[J]. 《计算机应用》唯一官方网站, 2023, 43(8): 2396-2405.
[7]	齐爱玲, 王宣淋. 基于中层细微特征提取与多尺度特征融合细粒度图像识别[J]. 《计算机应用》唯一官方网站, 2023, 43(8): 2556-2563.
[8]	金泽熙, 李磊, 刘继. 基于改进领域分离网络的迁移学习模型[J]. 《计算机应用》唯一官方网站, 2023, 43(8): 2382-2389.
[9]	李豆豆, 李汪根, 夏义春, 束阳, 高坤. 基于特征交互与自适应融合的骨骼动作识别[J]. 《计算机应用》唯一官方网站, 2023, 43(8): 2581-2587.
[10]	拓雨欣, 薛涛. 融合指针网络与关系嵌入的三元组联合抽取模型[J]. 《计算机应用》唯一官方网站, 2023, 43(7): 2116-2124.
[11]	张奕, 蔡钢生, 王真梅. 基于语义与全局双重注意力机制的长链非编码RNA-疾病关联预测模型[J]. 《计算机应用》唯一官方网站, 2023, 43(7): 2125-2132.
[12]	秦源源, 张鸿. 基于注意力特征金字塔网络的肺结节检测算法[J]. 《计算机应用》唯一官方网站, 2023, 43(7): 2311-2318.
[13]	何嘉明, 杨巨成, 吴超, 闫潇宁, 许能华. 基于多模态图卷积神经网络的行人重识别方法[J]. 《计算机应用》唯一官方网站, 2023, 43(7): 2182-2189.
[14]	魏远, 林彦, 郭晟楠, 林友芳, 万怀宇. 融合出发地与目的地时空相关性的城市区域间出租车需求预测[J]. 《计算机应用》唯一官方网站, 2023, 43(7): 2100-2106.
[15]	李忠雨, 孙浩东, 李娇. 轻量化篮球裁判手势识别算法[J]. 《计算机应用》唯一官方网站, 2023, 43(7): 2173-2181.

融合匹配长短时记忆网络和语法距离的方面级情感分析模型

Aspect-based sentiment analysis model integrating match-LSTM network and grammatical distance

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics