Neural abstractive summarization fusing by global generative topics

被引:0
作者
Yang Gao
Yang Wang
Luyang Liu
Yidi Guo
Heyan Huang
机构
[1] School of Computer Science and Technology,
[2] Beijing Institute of Technology,undefined
来源
Neural Computing and Applications | 2020年 / 32卷
关键词
Neural network; Variational auto-encoding; Abstractive summarization; Deep learning;
D O I
暂无
中图分类号
学科分类号
摘要
Various efforts have been dedicated to automatically generate coherent, condensed and informative summaries. Most concentrate on improving the capability of generating neural language models locally, but do not consider global information. In real cases, a summary is comprehensively influenced by the full content of the source text and is especially guided by its core sense. To seamlessly integrate global semantic representation into a summarization generation system, we propose to incorporate a neural generative topic matrix as an abstractive level of topic information. By mapping global semantics into a local generative language model, the abstractive summarization is capable of generating succinct and recapitulative words or phrases. Extensive experiments on DUC-2004 and Gigaword datasets convincingly validate the proposed model.
引用
收藏
页码:5049 / 5058
页数:9
相关论文
共 21 条
[1]  
Hinton GE(1995)The “wake-sleep” algorithm for unsupervised neural networks Science 268 1158-1161
[2]  
Dayan P(1997)Long short-term memory Neural Comput 9 1735-1780
[3]  
Frey BJ(2014)Sequence to sequence learning with neural networks Adv Neural Inf Process Syst 4 3104-3112
[4]  
Neal RM(2016)Organizing books and authors by multilayer som IEEE Trans Neural Netw Learn Syst 27 2537-2550
[5]  
Hochreiter S(2017)Understanding subtitles by character-level sequence-to-sequence learning IEEE Trans Ind Inform 13 616-624
[6]  
Schmidhuber J(2018)Locality reconstruction models for book representation IEEE Trans Knowl Data Eng 30 1873-1886
[7]  
Sutskever I(undefined)undefined undefined undefined undefined-undefined
[8]  
Vinyals O(undefined)undefined undefined undefined undefined-undefined
[9]  
Le QV(undefined)undefined undefined undefined undefined-undefined
[10]  
Zhang H(undefined)undefined undefined undefined undefined-undefined