Journal of Computer Applications ›› 2019, Vol. 39 ›› Issue (1): 160-167.DOI: 10.11772/j.issn.1001-9081.2018061232

Previous Articles     Next Articles

Sentiment analysis of entity aspects based on multi-attention long short-term memory

ZHI Shuting1,2, LI Xiaoge1,2, WANG Jingbo3, WANG Penghua1,2   

  1. 1. School of Computer Science & Technology, Xi'an University of Posts and Telecommunications, Xi'an Shaanxi 710121, China;
    2. Shaanxi Provincial Key Laboratory of Network Data Analysis and Intelligent Processing(Xi'an University of Posts and Telecommunications), Xi'an Shaanxi 710121, China;
    3. Artificial Intelligence & Cloud Platform, Beijing Xiaomi Intelligent Technology Company Limited, Beijing 100085, China
  • Received:2018-06-13 Revised:2018-08-26 Online:2019-01-10 Published:2019-01-21
  • Supported by:
    This work is partially supported by the Shaanxi Provincial Key Research and Development Project (2018ZDXM-GY-043), the Shaanxi Science and Technology Innovation Foundation Project (2016KTZDGY04-03), the Major Science and Technology Innovation Project in Xianyang City, Shaanxi Province (103-203990009), the Graduate Innovation Foundation Project of Xi'an University of Posts & Telecommunications (103-602080017).

基于多注意力长短时记忆的实体属性情感分析

支淑婷1,2, 李晓戈1,2, 王京博3, 王鹏华1,2   

  1. 1. 西安邮电大学 计算机学院, 西安 710121;
    2. 陕西省网络数据分析与智能处理重点实验室(西安邮电大学), 西安 710121;
    3. 北京小米智能科技有限公司 人工智能与云平台, 北京 100085
  • 通讯作者: 李晓戈
  • 作者简介:支淑婷(1994-),女,山西运城人,硕士研究生,主要研究方向:自然语言处理、文本数据挖掘;李晓戈(1962-),男,安徽合肥人,教授,博士,主要研究方向:自然语言处理、机器学习、数据挖掘;王京博(1995-),男,陕西渭南人,工程师,主要研究方向:自然语言处理、机器学习;王鹏华(1991-),男,陕西咸阳人,硕士研究生,主要研究方向:自然语言处理、机器学习。
  • 基金资助:
    陕西省重点研发计划项目(2018ZDXM-GY-043);陕西省科技创新基金资助项目(2016KTZDGY04-03);陕西省咸阳市重大科技创新专项(103-203990009);西安邮电大学研究生创新基金资助项目(103-602080017)。

Abstract: Aspect sentiment analysis is a fine-grained task in sentiment classification. Concerning the problem that traditional neural network model can not accurately construct sentiment features of aspects, a Long Short-Term Memory with Multi-ATTention and Aspect Context (LSTM-MATT-AC) neural network model was proposed. Different types of attention mechanisms were added in different positions of bidirectional Long Short-Term Memory (LSTM), and the advantage of multi-attention mechanism was fully utilized to allow the model to focus on sentiment information of specific aspects in sentence from different perspectives, which could compensate the deficiency of single attention mechanism. At the same time, combining aspect context information of bidirectional LSTM independent coding, the model could capture deeper level sentiment information and effectively distinguish sentiment polarity of different aspects. Experiments on SemEval2014 Task4 and Twitter datasets were carried out to verify the effectiveness of different attention mechanisms and independent context processing on aspect sentiment analysis. The experimental results show that the accuracy of the proposed model reaches 80.6%, 75.1% and 71.1% respectively for datasets in domain Restaurant, Laptop and Twitter. Compared with previous neural network-based sentiment analysis models, the accuracy has been further improved.

Key words: aspect sentiment analysis, multi-attention mechanism, contextual semantic feature, neural network, Natural Language Processing (NLP)

摘要: 属性情感分析是细粒度的情感分类任务。针对传统神经网络模型无法准确构建属性情感特征的问题,提出了一种融合多注意力和属性上下文的长短时记忆(LSTM-MATT-AC)神经网络模型。在双向长短时记忆(LSTM)的不同位置加入不同类型的注意力机制,充分利用多注意力机制的优势,让模型能够从不同的角度关注句子中特定属性的情感信息,弥补了单一注意力机制的不足;同时,融合双向LSTM独立编码的属性上下文语义信息,获取更深层次的情感特征,有效识别特定属性的情感极性;最后在SemEval2014 Task4和Twitter数据集上进行实验,验证了不同注意力机制和独立上下文处理方式对属性情感分析模型的有效性。实验结果表明,模型在Restaurant、Laptop和Twitter领域数据集上的准确率分别达到了80.6%、75.1%和71.1%,较之前基于神经网络的情感分析模型在准确率上有了进一步的提高。

关键词: 属性情感分析, 多注意力机制, 上下文语义特征, 神经网络, 自然语言处理

CLC Number: