• •    

基于深度学习的问答匹配

荣光辉1,黄震华2   

  1. 1. 上海市嘉定区曹安公路4800号
    2. 同济大学
  • 收稿日期:2017-05-03 修回日期:2017-07-03 发布日期:2017-07-03
  • 通讯作者: 荣光辉

Research on Question Answer Matching Based on Deep Learning Model

,   

  • Received:2017-05-03 Revised:2017-07-03 Online:2017-07-03

摘要: 智能问答是自然语言处理任务中重要的组成部分,基于传统方法的问答匹配存在人工依赖高,效率差,准确率低等问题。运用深度学习方法表示句子中抽象的语义具有特征明显优势,而注意力机制(attention mechanism)模型能够关注到句子中具有关键语义信息的词,降低一些非关键噪音词语对匹配的影响。针对问答匹配,本文提出了基于循环神经网络(RNN)和卷积神经网络(CNN),并引入了注意力机制的深度学习模型,可以有效地学习句子中词序,语义和关键信息特征。实验结果表明,在不需要额外人工制定特征规则的条件下,依然可以表现出不错的效果和较高的准确率。

关键词: 问答匹配, 深度学习, 注意力机制, 循环神经网络, 卷积神经网络

Abstract: Intelligent Question Answering is an important part of Natural Language Processing task.The Chinese Question Answer matching based on traditional methods has the problem of high labor dependence, poor efficiency and low accuracy.Using deep learning method to learn the abstract semantic information in sentence has obvious advantages ,as well as attention mechanism based model can concern the critical semantic information of words in sentence,reducing the impact of some non-critical noise words on matching results.For question answer matching,This paper propose deep learning model based on recurrent neural network (RNN) and convolution neural network (CNN) with combining attention mechanism.It can effectively learn word order, semantics and key information characteristics in the sentence.Experimental results show that it still has good results and high accuracy of question answer matching on the condition that without manual additional rules to formulate the characteristic.

Key words: Question Answer Matching, deep learning, attention mechanism, recurrent neural network, convolution neural network

中图分类号: