Sentence selection for generic document summarization using an adaptive differential evolution algorithm

被引:61
作者
Alguliev, Rasim M. [1 ]
Aliguliyev, Ramiz M. [1 ]
Mehdiyev, Chingiz A. [1 ]
机构
[1] Natl Acad Sci Azerbaijan, Inst Informat Technol, Baku, Azerbaijan
关键词
Document summarization; Redundancy; Content coverage; Optimization model; Adaptive differential evolution; OPTIMIZATION; PARAMETERS; MUTATION; ENSEMBLE;
D O I
10.1016/j.swevo.2011.06.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For effective multi-document summarization, it is important to reduce redundant information in the summaries and extract sentences, which are common to given documents. This paper presents a document summarization model which extracts key sentences from given documents while reducing redundant information in the summaries. An innovative aspect of our model lies in its ability to remove redundancy while selecting representative sentences. The model is represented as a discrete optimization problem. To solve the discrete optimization problem in this study an adaptive DE algorithm is created. We implemented our model on multi-document summarization task. Experiments have shown that the proposed model is to be preferred over summarization systems. We also showed that the resulting summarization system based on the proposed optimization approach is competitive on the DUC2002 and DUC2004 datasets. (C) 2011 Elsevier Ltd. All rights reserved.
引用
收藏
页码:213 / 222
页数:10
相关论文
共 60 条
[1]   Differential evolution with preferential crossover [J].
Ali, M. M. .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2007, 181 (03) :1137-1147
[2]   Differential evolution with generalized differentials [J].
Ali, M. M. .
JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2011, 235 (08) :2205-2216
[3]   A new sentence similarity measure and sentence based extractive technique for automatic text summarization [J].
Aliguliyev, Ramiz M. .
EXPERT SYSTEMS WITH APPLICATIONS, 2009, 36 (04) :7764-7772
[4]  
[Anonymous], 2008, P 17 ACM C INF KNOWL, DOI DOI 10.1145/1458082.1458319
[5]  
[Anonymous], 2002, ADV INTELL SYST FUZZ
[6]  
[Anonymous], P 20087 4 INT C SEM
[7]  
[Anonymous], Document understanding conferences
[8]  
[Anonymous], 2007, IJCAI
[9]   Self-adapting control parameters in differential evolution: A comparative study on numerical benchmark problems [J].
Brest, Janez ;
Greiner, Saso ;
Boskovic, Borko ;
Mernik, Marjan ;
Zumer, Vijern .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2006, 10 (06) :646-657
[10]   Self-adaptive differential evolution algorithm using population size reduction and three strategies [J].
Brest, Janez ;
Maucec, Mirjam Sepesy .
SOFT COMPUTING, 2011, 15 (11) :2157-2174