Abstract: Word embedding technology plays an important role in text sentiment analysis, but the traditional word embedding technologies such as Word2Vec and GloVe (Global Vectors for word representation) will lead to the problem of single semantics. Aiming at the above problem, a text sentiment analysis model named Sentiment Lexicon Parallel-Embedding from Language Model (SLP-ELMo) based on sentiment lexicon and context language model named Embedding from Language Model (ELMo) was proposed. Firstly, the sentiment lexicon was used to filter the words in the sentence. Secondly, the filtered words were input into the character-level Convolutional Neural Network (char-CNN) to generate the character vector of each word. Then, the character vectors were input into ELMo model for training. In addition, the attention mechanism was added to the last layer of ELMo vector to train the word vectors better. Finally, the word vectors and ELMo vector were combined in parallel and input into the classifier for text sentiment classification. Compared with the existing models, the proposed model achieves higher accuracy on IMDB and SST-2 datasets, which validates the effectiveness of the model.

Key words: sentiment analysis, Embedding from Language Model (ELMo), sentiment lexicon, Convolutional Neural Network (CNN), character vector

摘要： 词嵌入技术在文本情感分析中发挥着重要的作用，但是传统的Word2Vec、GloVe等词嵌入技术会产生语义单一的问题。针对上述问题提出了一种融合情感词典与上下文语言模型ELMo的文本情感分析模型SLP-ELMo。首先，利用情感词典对句子中的单词进行筛选；其次，将筛选出的单词输入字符卷积神经网络（char-CNN），从而产生每个单词的字符向量；然后，将字符向量输入ELMo模型进行训练；此外，在ELMo向量的最后一层加入了注意力机制，以便更好地训练词向量；最后，将词向量与ELMo向量并行融合并输入分类器进行文本情感分类。与现有的多个模型对比，所提模型在IMDB和SST-2这两个数据集上均得到了更高的准确率，验证了模型的有效性。

关键词: 情感分析, ELMo, 情感词典, 卷积神经网络, 字符向量