An automatic part-of-speech tagger for Middle Low German

被引:2
作者
Koleva, Mariya [1 ]
Farasyn, Melissa [2 ]
Desmet, Bart [1 ]
Breitbarth, Anne [2 ]
Hoste, Veronique [1 ]
机构
[1] Univ Ghent, Language & Translat Technol Team LT3, Groot Brittannielaan 45, B-9000 Ghent, Belgium
[2] Univ Ghent, Dept Linguist IaLing, Blandijnberg 2, B-9000 Ghent, Belgium
关键词
historical linguistics; part-of-speech tagging; conditional random fields; feature selection; normalization;
D O I
10.1075/ijcl.22.1.05kol
中图分类号
H0 [语言学];
学科分类号
030303 ; 0501 ; 050102 ;
摘要
Syntactically annotated corpora are highly important for enabling large-scale diachronic and diatopic language research. Such corpora have recently been developed for a variety of historical languages, or are still under development. One of those under development is the fully tagged and parsed Corpus of Historical Low German (CHLG), which is aimed at facilitating research into the highly under-researched diachronic syntax of Low German. The present paper reports on a crucial step in creating the corpus, viz. the creation of a part-of-speech tagger for Middle Low German (MLG). Having been transmitted in several non-standardised written varieties, MLG poses a challenge to standard POS taggers, which usually rely on normalized spelling. We outline the major issues faced in the creation of the tagger and present our solutions to them.
引用
收藏
页码:107 / 140
页数:34
相关论文
共 52 条
  • [1] [Anonymous], THESIS
  • [2] [Anonymous], 1993, COMPUT LINGUIST, DOI DOI 10.21236/ADA273556
  • [3] [Anonymous], 2014, P 8 WORKSHOP LANGUAG, DOI 10.3115/v1/W14-0605
  • [4] [Anonymous], P 19 NORD C COMP LIN
  • [5] Barteld Fabian, 2015, P WORKSH CORP BAS RE, P3
  • [6] Bennett P., 2010, P LREC 2010 WORKSH L, P64
  • [7] Biebersteadt A, 2015, 2015 JB GERMANISTISC, V6, P88
  • [8] Bollmann M., 2014, P 8 WORKSH LANG TECH, P86
  • [9] Braunmüller K, 2002, HANDB SPRACH KOMMUN, V22, P1028
  • [10] Breitbarth A., 2012, FOR GERM LANG STUD F