Extractive Summarization Based on Quadratic Check

被引:0
作者
Cheng, Yanfang [1 ]
Lu, Yinan [1 ]
机构
[1] Jilin Univ, Changchun, Peoples R China
来源
PROCEEDINGS OF THE THIRD INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND APPLICATION ENGINEERING (CSAE2019) | 2019年
关键词
Natural Language Processing (NLP); Extractive Summarization; Transformer; Scoring and Selecting;
D O I
10.1145/3331453.3361304
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Aiming to solve the problems of insufficient semantic understanding and low statement accuracy in the automatic text summarization of natural language processing, in this paper we present a novel neural network method for extractive summarization by Quadratic Check. The sentence extractor extracts the primary sentences by a scoring and selecting module, among which it selects the final sentences based on impact factor computed by the transformer model and builds the output summary by the quadratic check. The transformer model based on attention mechanisms is trained and generates the probability impact factor of each sentence used for further predicting the relative importance of the sentences. Meanwhile word frequency and position information are used in the process of extractive summarization. Finally, the effectiveness of the proposed method is verified by the experiments on CNN/Daily Mail and DUC2002 datasets.
引用
收藏
页数:5
相关论文
共 24 条
  • [1] Ahmed K., 2017, CORR
  • [2] [Anonymous], 2016, Tying Word Vectors and Word Classifiers: A Loss Framework for Language Modeling
  • [3] Bahdanau D, 2016, Arxiv, DOI arXiv:1409.0473
  • [4] Chen Huadong, 2017, ARXIV170705436
  • [5] Cheng Jianpeng, 2016, Long Papers, DOI [10.18653/V1/P16-1046, DOI 10.18653/V1/P16-1046]
  • [6] Cho K., 2014, P SSST8 8 WORKSH SYN, P103, DOI 10.3115/v1/w14-4012
  • [7] Domhan T, 2018, PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, P1799
  • [8] LexRank: Graph-based lexical centrality as salience in text summarization
    Erkan, G
    Radev, DR
    [J]. JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2004, 22 : 457 - 479
  • [9] Jadhav A, 2018, PROCEEDINGS OF THE 56TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS (ACL), VOL 1, P142
  • [10] Kejun Z, 2019, J COMPUTER APPL