Abstract:

Existing aspect-based sentiment analysis methods do not use enough information of syntactic dependency trees， ignore the associations between multiple aspect words， and lack the use of external knowledge. Aiming at these problems， a Knowledge Enhanced Aspect word Interactive Graph neural network （KEAIG） model was proposed. Firstly， BERT-PT （Bidirectional Encoder Representation from Transformers with Post-Train） fused with domain knowledge was used to encode text， and the knowledge graph was used to add sentiment information to the syntactic trees. The information contained in the syntactic dependency tree was extracted by the model in two parts： in the first part， the association relationships in the syntactic dependency tree and the part-of-speech tag of each word were used to extract sentence features， and in the second part， the feature extraction was performed on the syntactic dependency tree combined with the knowledge graph. Afterwards， the fusion gated unit was used to fuse the association features of multiple aspect words. Finally， the two parts of the sentence representations were concatenated together as the final classification basis. Experimental results on four datasets show that compared with the benchmark model Relational Graph Attention Network （RGAT）， the proposed model improves the accuracy by 2.17%， 5.54%， 2.60%， and 2.83%， respectively， and the F1 score （Macro?F1） by 2.69% and 6.87%， 8.77%， and 14.70%， respectively， fully demonstrating the effectiveness of using syntactic trees， introducing external knowledge and extracting multi-aspect word associations.

Key words: aspect-based sentiment analysis, syntactic dependency tree, domain knowledge, knowledge graph, Graph Neural Network (GNN), gated unit, aspect word interaction

摘要：

现有的方面级情感分析方法对句法依存树蕴含信息使用不足，忽略多方面词之间的关联，并且缺少对外部知识的使用。针对这些问题，提出一种知识增强的方面词交互图神经网络（KEAIG）模型。首先利用融合领域知识的BERT-PT （Bidirectional Encoder Representation from Transformers with Post-Train）编码文本，并利用知识图谱增加句法树的情感信息。模型分两部分对句法依存树蕴含的信息进行提取：第一部分利用句法依存树中的关联关系和每个单词的词性标签提取句子特征，第二部分对融入知识图谱的句法依存树进行特征提取。之后使用融合门控单元将多方面词关联特征融合进提取到的特征中。最后将两部分句子表示拼接起来作为最终分类依据。在4个数据集上的实验结果表明，所提模型相较于基准模型关系图注意力网络（RGAT），在准确率上分别提升了2.17%、5.54%、2.60%和2.83%，在F1值（Macro?F1）上分别提升了2.69%、6.87%、8.77%和14.70%，充分表明了利用句法树、引入外部知识和提取多方面词关联的有效性。

关键词: 方面级情感分析, 句法依存树, 领域知识, 知识图谱, 图神经网络, 门控单元, 方面词交互