Stable Classification of Text Genres

被引:28
作者
Petrenz, Philipp [1 ]
Webber, Bonnie [1 ]
机构
[1] Univ Edinburgh, Edinburgh EH8 9AB, Midlothian, Scotland
关键词
D O I
10.1162/COLI_a_00052
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Every text has at least one topic and at least one genre. Evidence for a text's topic and genre comes, in part, from its lexical and syntactic features-features used in both Automatic Topic Classification and Automatic Genre Classification (AGC). Because an ideal AGC system should be stable in the face of changes in topic distribution, we assess five previously published AGC methods with respect to both performance on the same topic-genre distribution on which they were trained and stability of that performance across changes in topic-genre distribution. Our experiments lead us to conclude that (1) stability in the face of changing topical distributions should be added to the evaluation critera for new approaches to AGC, and (2) part-of-speech features should be considered individually when developing a high-performing, stable AGC system for a particular, possibly changing corpus.
引用
收藏
页码:385 / 393
页数:9
相关论文
共 13 条
[11]  
Sharoff S, 2010, LREC 2010 - SEVENTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, P3063
[12]   Feature-rich part-of-speech tagging with a cyclic dependency network [J].
Toutanova, K ;
Klein, D ;
Manning, CD ;
Singer, Y .
HLT-NAACL 2003: HUMAN LANGUAGE TECHNOLOGY CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE MAIN CONFERENCE, 2003, :252-259
[13]   BIAS AND THE QUANTIFICATION OF STABILITY [J].
TURNEY, P .
MACHINE LEARNING, 1995, 20 (1-2) :23-33