Abstract Text Summarization with a Convolutional Seq2seq Model

被引:34
|
作者
Zhang, Yong [1 ]
Li, Dan [1 ]
Wang, Yuheng [1 ]
Fang, Yang [1 ]
Xiao, Weidong [1 ]
机构
[1] Natl Univ Def Technol, Sci & Technol Informat Syst Engn Lab, Changsha 410073, Hunan, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2019年 / 9卷 / 08期
关键词
abstract text summarization; convolutional neural network; Seq2seq model;
D O I
10.3390/app9081665
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
text summarization aims to offer a highly condensed and valuable information that expresses the main ideas of the text. Most previous researches focus on extractive models. In this work, we put forward a new generative model based on convolutional seq2seq architecture. A hierarchical CNN framework is much more efficient than the conventional RNN seq2seq models. We also equip our model with a copying mechanism to deal with the rare or unseen words. Additionally, we incorporate a hierarchical attention mechanism to model the keywords and key sentences simultaneously. Finally we verify our model on two real-life datasets, GigaWord and DUC corpus. The experiment results verify the effectiveness of our model as it outperforms state-of-the-art alternatives consistently and statistical significantly.
引用
收藏
页数:13
相关论文
共 38 条
  • [1] Optimized Seq2Seq model based on multiple methods for short-term power load forecasting
    Dai, Yeming
    Yang, Xinyu
    Leng, Mingming
    APPLIED SOFT COMPUTING, 2023, 142
  • [2] Short-term wind power forecasting approach based on Seq2Seq model using NWP data
    Zhang, Yu
    Li, Yanting
    Zhang, Guangyao
    ENERGY, 2020, 213
  • [3] An Optimized Abstractive Text Summarization Model Using Peephole Convolutional LSTM
    Rahman, Md Motiur
    Siddiqui, Fazlul Hasan
    SYMMETRY-BASEL, 2019, 11 (10):
  • [4] Optimization of the Abstract Text Summarization Model Based on Multi-Task Learning
    Yao, Ben
    Ding, Gejian
    PROCEEDINGS OF 2023 7TH INTERNATIONAL CONFERENCE ON ELECTRONIC INFORMATION TECHNOLOGY AND COMPUTER ENGINEERING, EITCE 2023, 2023, : 424 - 428
  • [5] Convolutional Neural Network based for Automatic Text Summarization
    Alquliti, Wajdi Homaid
    Ghani, Norjihan Binti Abdul
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2019, 10 (04) : 200 - 211
  • [6] Seq2Image: Sequence Analysis using Visualization and Deep Convolutional Neural Network
    Tavakoli, Neda
    2020 IEEE 44TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE (COMPSAC 2020), 2020, : 1332 - 1337
  • [7] Constraint-Based Adversarial Networks for Unsupervised Abstract Text Summarization
    Jing, Liwei
    Yang, Lina
    Yuan, Yujian
    Meng, Zuqiang
    Tan, Yifeng
    Wang, Patrick Shen-Pei
    Li, Xichun
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2023, 37 (12)
  • [8] Gene Regulatory Network Inference Using Convolutional Neural Networks from scRNA-seq Data
    Mao, Guo
    Pang, Zhengbin
    Zuo, Ke
    Liu, Jie
    JOURNAL OF COMPUTATIONAL BIOLOGY, 2023, 30 (05) : 619 - 631
  • [9] Seq2Img: A Sequence-to-Image based Approach Towards IP Traffic Classification using Convolutional Neural Networks
    Chen, Zhitang
    He, Ke
    Li, Jian
    Geng, Yanhui
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 1271 - 1276
  • [10] TULIP: An RNA-seq-based Primary Tumor Type Prediction Tool Using Convolutional Neural Networks
    Jones, Sara
    Beyers, Matthew
    Shukla, Maulik
    Xia, Fangfang
    Brettin, Thomas
    Stevens, Rick
    Weil, M. Ryan
    Ganakammal, Satishkumar Ranganathan
    CANCER INFORMATICS, 2022, 21