Abstract:

Aiming at the problem that most of existing models for document-level sentiment analysis only consider encoding text at word level， an attention sentiment analysis model based on multi-scale convolution and gating mechanism was proposed. Firstly， in order to obtain more different levels of text semantic information and form a richer text representation， the multi-scale convolution was used to capture local correlations of different granularities. Secondly， considering the influence of user personality and product information on text sentiment classification， the global information of users and products was integrated into attention to capture key semantic components which were highly related to users and products to form the document representation. Thirdly， a gating mechanism was introduced to control the path of emotional information flowing to collection layer. Finally， the sentiment classification was realized through the fully connected layer and argmax function. The experimental results show that， compared with the baseline model with the most advanced performance， the proposed algorithm has the sentiment classification accuracy on IMDB and Yelp2014 datasets improved by 1.2 percentage points and 0.7 percentage points respectively， and obtains the smallest Root Mean Squared Error （RMSE） on IMDB and Yelp2013 datasets.

Key words: sentiment analysis, Convolutional Neural Network (CNN), attention mechanism, multi-scale convolution, gating mechanism

摘要：

针对现有的文档级情感分析模型大多只是考虑从词级对文本进行编码的问题，提出了一种基于多尺度卷积和门控机制的注意力情感分析模型。首先，使用多尺度卷积捕获不同粒度的局部相关性，从而得到更多不同层次的文本语义信息并形成更丰富的文本表示；其次，考虑到用户个性及产品信息对文本情感分类的影响，将全局用户产品信息融合到注意力中捕捉与用户和产品相关度较高的关键语义成分来生成文档表示；然后，引入门控机制来控制情感信息流向汇集层的路径；最后，通过全连接层和argmax函数实现情感分类。实验结果表明，与基准模型中性能最好的相比，所提模型在IMDB和Yelp2014两个数据集上的情感分类准确率分别提高了1.2个百分点和0.7个百分点，并且在IMDB和Yelp2013数据集上获得了最小的均方根误差（RMSE）。

关键词: 情感分析, 卷积神经网络, 注意力机制, 多尺度卷积, 门控机制