Arabic text summarization using deep learning approach

被引:25
作者
Al-Maleh, Molham [1 ]
Desouki, Said [2 ]
机构
[1] Higher Inst Appl Sci & Technol, Fac Informat Technol, Damascus, Syria
[2] Arab Int Univ, Fac Informat & Commun Engn, Damascus, Syria
关键词
Natural language processing; Text summarization; Deep learning; Big data; Sequence-to-sequence framework;
D O I
10.1186/s40537-020-00386-7
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Natural language processing has witnessed remarkable progress with the advent of deep learning techniques. Text summarization, along other tasks like text translation and sentiment analysis, used deep neural network models to enhance results. The new methods of text summarization are subject to a sequence-to-sequence framework of encoder-decoder model, which is composed of neural networks trained jointly on both input and output. Deep neural networks take advantage of big datasets to improve their results. These networks are supported by the attention mechanism, which can deal with long texts more efficiently by identifying focus points in the text. They are also supported by the copy mechanism that allows the model to copy words from the source to the summary directly. In this research, we are re-implementing the basic summarization model that applies the sequence-to-sequence framework on the Arabic language, which has not witnessed the employment of this model in the text summarization before. Initially, we build an Arabic data set of summarized article headlines. This data set consists of approximately 300 thousand entries, each consisting of an article introduction and the headline corresponding to this introduction. We then apply baseline summarization models to the previous data set and compare the results using the ROUGE scale.
引用
收藏
页数:17
相关论文
共 32 条
  • [21] Imam I., 2013, International Journal of Computer Applications, V74
  • [22] Using hidden Markov modeling to decompose human-written summaries
    Jing, HY
    [J]. COMPUTATIONAL LINGUISTICS, 2002, 28 (04) : 527 - 543
  • [23] Summarization beyond sentence extraction: A probabilistic approach to sentence compression
    Knight, K
    Marcu, D
    [J]. ARTIFICIAL INTELLIGENCE, 2002, 139 (01) : 91 - 107
  • [24] Li V.O, 2016, ARXIV160306393
  • [25] The Stanford CoreNLP Natural Language Processing Toolkit
    Manning, Christopher D.
    Surdeanu, Mihai
    Bauer, John
    Finkel, Jenny
    Bethard, Steven J.
    McClosky, David
    [J]. PROCEEDINGS OF 52ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: SYSTEM DEMONSTRATIONS, 2014, : 55 - 60
  • [26] Nallapati R., 2016, CoRR
  • [27] Effectiveness analysis of machine learning classification models for predicting personalized context-aware smartphone usage
    Sarker, Iqbal H.
    Kayes, A. S. M.
    Watters, Paul
    [J]. JOURNAL OF BIG DATA, 2019, 6 (01)
  • [28] See A, 2017, ARXIV170404368
  • [29] Sobh I, 2009, THESIS
  • [30] Tu Z, 2016, M ASS COMP LING