• •    

基于迁移学习的文本共情预测

李晨光1,张波2,赵骞2,陈小平3,王行甫4   

  1. 1. 中国科学技术大学计算机科学与工程学院
    2. 国网安徽省电力有限公司
    3. 中国科学技术大学多智能体系统实验室
    4. 中国科学技术大学
  • 收稿日期:2021-09-16 修回日期:2022-01-13 发布日期:2022-04-15
  • 通讯作者: 李晨光
  • 基金资助:
    面向航空制造的人-机器人协作技术及应用研究

Empathy Prediction from Texts based on Transfer Learning

  • Received:2021-09-16 Revised:2022-01-13 Online:2022-04-15

摘要: 由于缺乏足够的训练数据,文本共情预测这一领域的进展一直都较为缓慢。与此同时,其相关任务,即文本情感极性分类任务存在大量的有标签的训练样本。因此提出了一种基于迁移学习的文本共情预测方法,该方法可从情感极性分类任务中学习到可迁移的公共特征,并进而通过学习到的公共特征辅助共情预测任务。具体而言,所提方法首先通过一个注意力机制对两个任务间的公私有特征进行动态加权融合;其次为了消除两个任务间的数据集领域差异,提出了一种对抗学习策略来区分两个任务间的领域独有特征与领域公共特征;最后提出了一种 hinge-loss 约束策略来使得共同特征对不同的目标标签具有通用性,而私有特征对不同的目标标签具有独有性。在基准数据集上进行的实验与相关的实验结果证明了所提方法的有效性。

关键词: 自然语言处理, 情感分析, 深度学习, 共情预测, 迁移学习

Abstract: Empathy prediction from texts has achieved little progress due to the lack of sufficient labeled data, while its related task, polarity classification with a large number of labeled samples, has been studied thoroughly. Therefore, we propose an empathy prediction method augmented by the polarity classification task. The proposed method erases the domain gaps and the label gaps between the empathy prediction and the polarity classification tasks, and successfully leverages the features learned from the polarity classification task to aid the empathy prediction task. First, we propose an attention-based feature fusion strategy, which assigns dynamic weights to the common features and the private features according to their contributions to empathy prediction. Second, we propose an adversarial learning strategy to disentangle the private and common features for the two tasks, which makes the common features general to different domains and the private features specific to the task-specific domain. Third, we design a hinge loss function to guide the representation learning, where the learned common and private features are general and specific to different target labels, respectively. Experimental results on benchmark databases demonstrate the effectiveness of the proposed method for empathy prediction.

Key words: Nature language processing, Sentiment analysis, Deep learning, Empathy prediction, Transfer learning

中图分类号: