HG-News: News Headline Generation Based on a Generative Pre-Training Model

被引:3
作者
Li, Ping [1 ]
Yu, Jiong [1 ]
Chen, Jiaying [1 ]
Guo, Binglei [2 ]
机构
[1] Xinjiang Univ, Coll Informat Sci & Engn, Urumqi 830000, Xinjiang, Peoples R China
[2] Hubei Univ Arts & Sci, Sch Comp Engn, Xiangyang 441053, Peoples R China
基金
中国国家自然科学基金;
关键词
Mathematical model; Decoding; Task analysis; Vocabulary; Computational modeling; Neural networks; Convolution; Generation model; headline generation; text summarization; neural network;
D O I
10.1109/ACCESS.2021.3102741
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Neural headline generation models have recently shown great results since neural network methods have been applied to text summarization. In this paper, we focus on news headline generation. We propose a news headline generation model based on a generative pre-training model. In our model, we propose a rich features input module. The headline generation model we propose only contains a decoder incorporating the pointer mechanism and the n-gram language features, while other generation models use the encoder-decoder architecture. Experiments on news datasets show that our model achieves comparable results in the field of news headline generation.
引用
收藏
页码:110039 / 110046
页数:8
相关论文
共 31 条
[1]  
[Anonymous], CVPR
[2]  
[Anonymous], 2015, CONF EMP METH NAT LA
[3]  
Bae S., 2019, Proceedings of the 2nd Workshop on New Frontiers in Summarization, P10
[4]  
Bahdanau D., 2015, P INT C LEARN REPR, P5998
[5]  
Bukhtiyarov A., ARXIV200705044
[6]  
Chen YC, 2018, PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, P675
[7]  
Chopra Sumit, 2016, P 2016 C N AM CHAPT, P93
[8]  
Chung J, 2014, P NEURIPS
[9]  
Devlin Jacob, 2018, P C N AM CHAPT ASS C
[10]  
Gehrmann S, 2018, 2018 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP 2018), P4098