Evaluation Of Automatic Text Summarizations Based On Human Summaries

被引:20
作者
Kiyoumarsi, Farshad [1 ]
机构
[1] Islamic Azad Univ, Shahrekord Branch, Tehran, Iran
来源
PROCEEDINGS OF 2ND GLOBAL CONFERENCE ON CONFERENCE ON LINGUISTICS AND FOREIGN LANGUAGE TEACHING | 2015年 / 192卷
关键词
eveluation; manually-produced; fuzzy method;
D O I
10.1016/j.sbspro.2015.06.013
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
The goal of this paper is to compare summaries generated by different automatic text summarization methods and those generated by human beings. To achieve this end, we did two series of experiments: in the first one, we employed automatically produced extractive summaries; in the second one, manually-produced summaries obtained by several English teachers were used. Our automatic summaries were obtained using Fuzzy method and Vector approach. Using Rouge evaluation system, we compared the manually-produced summaries and the automatically-produced ones. Rouge evaluation of generated summaries indicated the superiority of summaries produced by humans over the automatically produced summaries. On the other hand, the comparison between the generated summaries showed that summaries produced by Fuzzy method were much more acceptable and understandable compared to summaries produced by Vector approach. This can provide support for the replacement of manually generated summaries by summaries produced using Fuzzy method in certain cases where real time summaries are needed. (C) 2015 The Authors. Published by Elsevier Ltd.
引用
收藏
页码:83 / 91
页数:9
相关论文
共 23 条
[1]  
[Anonymous], 2001, Automatic summarization
[2]  
[Anonymous], 2003, P 2003 HUM LANG TECH
[3]  
[Anonymous], 2003, ROUGE RECALL ORIENTE
[4]  
[Anonymous], 2002, P ACL 2002 WORKSH AU
[5]  
Arman Kiani-B, 2002, INTELLIGENT EXTRACTI
[6]  
Buckley J.J., 2002, An Introduction to Fuzzy Logic and Fuzzy Sets, DOI [10.1007/978-3-7908-1799-7, DOI 10.1007/978-3-7908-1799-7]
[7]  
DUC, 2006, DOCUMENT UNDERSTANDI
[8]  
Elhadad Noemie, 2004, THESIS
[9]  
Ferrier L., 2001, A Maximum Entropy Approach to Text Summarization
[10]  
Fisher S., 2006, P DUC