基于宏观篇章结构的科技论文摘要模型

doi:10.11772/j.issn.1001-9081.2020121945

计算机应用 ›› 2021, Vol. 41 ›› Issue (10): 2864-2870.DOI: 10.11772/j.issn.1001-9081.2020121945

所属专题：人工智能

基于宏观篇章结构的科技论文摘要模型

付颖, 王红玲, 王中卿

苏州大学计算机科学与技术学院, 江苏苏州 215006

收稿日期:2020-12-11 修回日期:2021-03-04 出版日期:2021-10-10 发布日期:2021-07-16
通讯作者: 王红玲
作者简介:付颖(1994-),女,河南安阳人,硕士研究生,CCF会员,主要研究方向:自然语言处理;王红玲(1975-),女,江苏苏州人,副教授,博士,CCF会员,主要研究方向:自然语言处理;王中卿(1987-),男,江苏苏州人,副教授,博士,CCF会员,主要研究方向:自然语言处理。
基金资助:
国家自然科学基金面上项目（61976146）。

Scientific paper summarization model using macro discourse structure

FU Ying, WANG Hongling, WANG Zhongqing

School of Computer Science and Technology, Soochow University, Suzhou Jiangsu 215006, China

Received:2020-12-11 Revised:2021-03-04 Online:2021-10-10 Published:2021-07-16
Supported by:
This work is partially supported by the Surface Program of National Natural Science Foundation of China (61976146).

摘要/Abstract

摘要： 针对传统的神经网络模型不能较好地反映科技论文内不同章节之间的宏观篇章结构信息，从而容易导致生成的科技论文摘要结构不完整、内容不连贯的问题，提出了一种基于宏观篇章结构的科技论文摘要模型。首先，搭建了一种基于宏观篇章结构的层级编码器，并利用图卷积神经网络对章节间的宏观篇章结构信息进行编码，从而构建章节层级语义表示；然后，提出了一个信息融合模块，旨在将宏观篇章结构信息和单词层级信息进行有效融合，从而辅助解码器生成摘要；最后，利用注意力机制优化单元对上下文向量进行更新优化操作。实验结果表明，所提出的模型比基准模型分别在ROUGE-1、ROUGE-2以及ROUGE-L上分别高出3.53个百分点、1.15个百分点和4.29个百分点，并且通过对生成的摘要内容进行分析对比，可进一步证明该模型可有效提高生成摘要的质量。

关键词: 神经网络, 宏观篇章结构, 科技论文摘要, 图卷积神经网络, 生成式摘要

Abstract: The traditional neural network model cannot reflect the macro discourse structure information between different sections in scientific paper, which leads to the incomplete structure and incoherent content of the generated scientific paper summarization. In order to solve the problem, a scientific paper summarization model using macro discourse structure was proposed. Firstly, a hierarchical encoder based on macro discourse structure was built. Graph convolution neural network was used to encode the macro discourse structure information between sections, so as to construct the hierarchical semantic representation of sections. Then, an information fusion module was proposed to effectively fuse macro discourse structure information and word-level information, so as to assist the decoder to generate the summarization. Finally, the attention mechanism optimization unit was used to update and optimize the context vector. Experimental results show that the proposed model is 3.53, 1.15 and 4.29 percetage points higher than the baseline model in ROUGE (Recall-Oriented Understudy for Gisting Evaluation)-1, ROUGE-2 and ROUGE-L respectively. Through the analysis and comparison of the generated summarization content, it can be further proved that the proposed model can effectively improve the quality of the generated summarization.

Key words: neural network, macro discourse structure, scientific paper summarization, graph convolution neural network, abstractive summarization

中图分类号:

TP391

付颖, 王红玲, 王中卿. 基于宏观篇章结构的科技论文摘要模型[J]. 计算机应用, 2021, 41(10): 2864-2870.

FU Ying, WANG Hongling, WANG Zhongqing. Scientific paper summarization model using macro discourse structure[J]. Journal of Computer Applications, 2021, 41(10): 2864-2870.

参考文献

[1] 石文川, 郭桂仙, 李川, 等. 摘要在科技论文中的重要性及写作技巧[J]. 河北农业大学学报, 2000, 23(4):111-113.(SHI W C, GUO G X, LI C, et al. The importance and writing skills of abstract in scientific papers[J]. Journal of Hebei Agricultural University, 2000, 23(4):111-113.)
[2] HERMANN K M, KOČISKÝ T, GREFENSTETTE E, et al. Teaching machines to read and comprehend[C]//Proceedings of the 28th International Conference on Neural Information Processing Systems. Cambridge:MIT Press, 2015:1693-1701.
[3] HUA L F, WAN X J, LI L. Overview of the NLPCC 2017 shared task:single document summarization[C]//Proceedings of the 2017 National CCF Conference on Natural Language Processing and Chinese Computing, LNCS 10619. Cham:Springer, 2017:942-947.
[4] VAN DIJK T A. Macrostructures:An Interdisciplinary Study of Global Structures in Discourse, Interaction, and Cognition[M]. Hillsdale, NJ:Lawrence Erlbaum Associates, Inc., 1980:67-93.
[5] VAN DIJK T A. Text and Context:Explorations in the Semantics and Pragmatics of Discourse[M]. London:Longman, 1977:83-95.
[6] VAN DIJK T A, KINTSCH W. Strategies of Discourse Comprehension[M]. New York:Academic Press, 1983:131-143.
[7] VAN DIJK T A. Handbook of Discourse Analysis[M]. London:Academic Press, 1985:137-157.
[8] VAN DIJK T A. News as Discourse[M]. New York:Routledge, 1990:121-157.
[9] 褚晓敏, 朱巧明, 周国栋. 自然语言处理中的篇章主次关系研究[J]. 计算机学报, 2017, 40(4):842-860.(CHU X M, ZHU Q M, ZHOU G D. Discourse primary-secondary relationships in natural language processing[J]. Chinese Journal of Computers, 2017, 40(4):842-860.)
[10] KIPF T N, WELLING M. Semi-supervised classification with graph convolutional networks[EB/OL]. (2017-02-22)[2020-12-03]. https://arxiv.org/pdf/1609.02907.pdf.
[11] XU Y, LAU J H, BALDWIN T, et al. Decoupling encoder and decoder networks for abstractive document summarization[C]//Proceedings of the MultiLing 2017 Workshop on Summarization and Summary Evaluation Across Source Types and Genres. Stroudsburg, PA:Association for Computational Linguistics, 2017:7-11.
[12] RUSH A M, CHOPRA S, WESTON J. A neural attention model for abstractive sentence summarization[C]//Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA:Association for Computational Linguistics, 2015:379-389.
[13] ZHOU Q Y, YANG N, WEI F R, et al. Selective encoding for abstractive sentence summarization[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA:Association for Computational Linguistics, 2017, 1:1095-1104.
[14] SEE A, LIU P J, MANNING C D. Get to the point:summarization with pointer-generator networks[C]//Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA:Association for Computational Linguistics, 2017, 1:1073-1083.
[15] COHAN A, DERNONCOURT F, KIM D S, et al. A discourseaware attention model for abstractive summarization of long documents[C]//Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics:Human Language Technologies. Stroudsburg, PA:Association for Computational Linguistics, 2018, 2:615-621.
[16] 吴仁守, 张宜飞, 王红玲, 等. 基于层次结构的生成式自动文摘[J]. 中文信息学报, 2019, 33(10):90-98.(WU R S, ZHANG Y F, WANG H L, et al. Abstractive summarization based on hierarchical structure[J]. Journal of Chinese Information Processing, 2019, 33(10):90-98.)
[17] 张迎, 张宜飞, 王中卿, 等. 基于主次关系特征的自动文摘方法[J]. 计算机科学, 2020, 47(6A):6-11.(ZHANG Y, ZHANG Y F, WANG Z Q, et al. Automatic summarization method based on primary and secondary relation features[J]. Computer Science, 2020, 47(6A):6-11.)
[18] HOCHREITER S, SCHMIDHUBER J. Long short-term memory[J]. Neural Computation, 1997, 9(8):1735-1780.
[19] ZHOU P, SHI W, TIAN J, et al. Attention-based bidirectional long short-term memory networks for relation classification[C]//Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics. Stroudsburg, PA:Association for Computational Linguistics, 2016, 2:207-212.
[20] LIN C Y, GAO J F, CAO G H, et al. Automatic evaluation of summaries:U. S., 2008/0189074 A1[P]. 2008-07-08.
[21] VANDERWENDE L, SUZUKI H, BROCKETT C, et al. Beyond SumBasic:task-focused summarization with sentence simplification and lexical expansion[J]. Information Processing and Management, 2007, 43(6):1606-1618.
[22] STEINBERGER J, JEŽEK K. Using latent semantic analysis in text summarization and summary evaluation[EB/OL].[2021-10-12]. http://www.kiv.zcu.cz/~jstein/publikace/isim2004.pdf.
[23] ERKAN G, RADEV D R. LexRank:graph-based lexical centrality as salience in text summarization[J]. Journal of Artificial Intelligence Research, 2004, 22:457-479.
[24] NALLAPATI R, ZHOU B W, DOS SANTOS C, et al. Abstractive text summarization using sequence-to-sequence RNNs and beyond[C]//Proceedings of the 20th SIGNLL Conference on Computational Natural Language Learning. Stroudsburg, PA:Association for Computational Linguistics, 2016:280-290.

基于宏观篇章结构的科技论文摘要模型

Scientific paper summarization model using macro discourse structure

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

[1]	王贺兵, 张春梅. 基于非对称卷积-压缩激发-次代残差网络的人脸关键点检测[J]. 计算机应用, 2021, 41(9): 2741-2747.
[2]	宋中山, 梁家锐, 郑禄, 刘振宇, 帖军. 基于双向门控尺度特征融合的遥感场景分类[J]. 计算机应用, 2021, 41(9): 2726-2735.
[3]	李康康, 张静. 基于注意力机制的多层次编码和解码的图像描述模型[J]. 计算机应用, 2021, 41(9): 2504-2509.
[4]	张永斌, 常文欣, 孙连山, 张航. 基于字典的域名生成算法生成域名的检测方法[J]. 计算机应用, 2021, 41(9): 2609-2614.
[5]	赵宏, 孔东一. 图像特征注意力与自适应注意力融合的图像内容中文描述[J]. 计算机应用, 2021, 41(9): 2496-2503.
[6]	徐江浪, 李林燕, 万新军, 胡伏原. 结合目标检测的室内场景识别方法[J]. 计算机应用, 2021, 41(9): 2720-2725.
[7]	牟长宁, 王海鹏, 周丕宇, 侯鑫行. 基于图卷积神经网络的串联质谱从头测序[J]. 计算机应用, 2021, 41(9): 2773-2779.
[8]	刘子辰, 李小娟, 韦伟. 基于循环神经网络的专利价格自动评估[J]. 计算机应用, 2021, 41(9): 2532-2538.
[9]	曾祥银, 郑伯川, 刘丹. 基于深度卷积神经网络和聚类的左右轨道线检测[J]. 计算机应用, 2021, 41(8): 2324-2329.
[10]	丁尹, 桑楠, 李晓瑜, 吴飞舟. 基于循环神经网络的电信行业容量数据预测方法[J]. 计算机应用, 2021, 41(8): 2373-2378.
[11]	秦斌斌, 彭良康, 卢向明, 钱江波. 司机分心驾驶检测研究进展[J]. 计算机应用, 2021, 41(8): 2330-2337.
[12]	黄程程, 董霄霄, 李钊. 基于二维Winograd算法的深流水线5×5卷积方法[J]. 计算机应用, 2021, 41(8): 2258-2264.
[13]	曹玉红, 徐海, 刘荪傲, 王紫霄, 李宏亮. 基于深度学习的医学影像分割研究综述[J]. 计算机应用, 2021, 41(8): 2273-2287.
[14]	武维, 李泽平, 杨华蔚, 林川, 王忠德. 融合内容特征和时序信息的深度注意力视频流行度预测模型[J]. 计算机应用, 2021, 41(7): 1878-1884.
[15]	武光利, 李雷霆, 郭振洲, 王成祥. 基于改进的双向长短期记忆网络的视频摘要生成模型[J]. 计算机应用, 2021, 41(7): 1908-1914.