Corpus based part-of-speech tagging

被引:6
作者
Lv, Chengyao [1 ]
Liu, Huihua [1 ]
Dong, Yuanxing [1 ]
Chen, Yunliang [1 ,2 ]
机构
[1] China Univ Geosci, Sch Foreign Language, Wuhan 430074, Peoples R China
[2] China Univ Geosci, Sch Comp Sci, Wuhan 430074, Peoples R China
基金
中国国家自然科学基金;
关键词
Natural language processing; POS tagging; Hidden markov models; Support vector machine; Neural networks; Gene expression programming;
D O I
10.1007/s10772-016-9356-2
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In natural language processing, a crucial subsystem in a wide range of applications is a part-of-speech (POS) tagger, which labels (or classifies) unannotated words of natural language with POS labels corresponding to categories such as noun, verb or adjective. Mainstream approaches are generally corpus-based: a POS tagger learns from a corpus of pre-annotated data how to correctly tag unlabeled data. Presented here is a brief state-of-the-art account on POS tagging. POS tagging approaches make use of labeled corpus to train computational trained models. Several typical models of three kings of tagging are introduced in this article: rule-based tagging, statistical approaches and evolution algorithms. The advantages and the pitfalls of each typical tagging are discussed and analyzed. Some rule-based and stochastic methods have been successfully achieved accuracies of 93-96 %, while that of some evolution algorithms are about 96-97 %.
引用
收藏
页码:647 / 654
页数:8
相关论文
共 52 条
  • [41] Shawe-Taylor J, 2000, INTRO SUPPORT VECTOR
  • [42] Smith T.C., 1995, P IJCAI 95 WORKSH NE, P17
  • [43] Sun G., 2008, P 11 JOINT C INF SCI
  • [44] Thede SM, 1999, P 37 ANN M ASS COMP, P175, DOI DOI 10.3115/1034678.1034712
  • [45] Tian Y, 2015, 2015 22ND INTERNATIONAL CONFERENCE ON SOFTWARE ANALYSIS, EVOLUTION, AND REENGINEERING (SANER), P570, DOI 10.1109/SANER.2015.7081879
  • [46] VARILE Giovanni Battista, 1997, SURVEY STATE ART HUM
  • [48] Voutilainen A, 2003, OXFORD HDB COMPUTATI, P219
  • [49] Wilks Y., 2000, AMSTERDAM STUDIES TH, V4, P117
  • [50] Evolving accurate and compact classification rules with gene expression programming
    Zhou, C
    Xiao, WM
    Tirpak, TM
    Nelson, PC
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2003, 7 (06) : 519 - 531