Evaluation of a Sentence Ranker for Text Summarization Based on Roget's Thesaurus

被引:0
作者
Kennedy, Alistair [1 ]
Szpakowicz, Stan [1 ]
机构
[1] Univ Ottawa, Sch Informat Technol & Engn, Ottawa, ON, Canada
来源
TEXT, SPEECH AND DIALOGUE | 2010年 / 6231卷
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Evaluation is one of the hardest tasks in automatic text summarization. It is perhaps even harder to determine how much a particular component of a summarization system contributes to the success of the whole system. We examine how to evaluate the sentence ranking component using a corpus which has been partially labelled with Summary Content Units. To demonstrate this technique, we apply it to the evaluation of a new sentence-ranking system which uses Roget's Thesaurus. This corpus provides a quick and nearly automatic method of evaluating the quality of sentence ranking.
引用
收藏
页码:101 / 108
页数:8
相关论文
共 14 条
  • [1] [Anonymous], 1997, 5 C APPL NAT LANG PR, DOI DOI 10.3115/974557.974599
  • [2] [Anonymous], 2007, ACM T SPEECH LANG PR
  • [3] Carbonell J., 1998, Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, P335, DOI 10.1145/290941.291025
  • [4] Copeck T., 2006, HLT NAACL 2006 DOC U
  • [5] Fuentes M., 2007, P 45 ANN M ACL INT P, P57
  • [6] Jarmasz M, 2004, AMST STUD THEORY HIS, V260, P111
  • [7] Jarmasz M, 2003, LECT NOTES ARTIF INT, V2671, P544
  • [8] Katragadda R., 2009, P ACL IJCNLP 2009 C, P105
  • [9] Katragadda R., 2009, CLIAWS3 '09: Proceedings of the 3rd International Workshop on Cross Lingual Information Access, P46
  • [10] Kennedy A., 2008, Proceedings of ACL-08: HLT, P416