Corpus based part-of-speech tagging

被引:6
作者
Lv, Chengyao [1 ]
Liu, Huihua [1 ]
Dong, Yuanxing [1 ]
Chen, Yunliang [1 ,2 ]
机构
[1] China Univ Geosci, Sch Foreign Language, Wuhan 430074, Peoples R China
[2] China Univ Geosci, Sch Comp Sci, Wuhan 430074, Peoples R China
基金
中国国家自然科学基金;
关键词
Natural language processing; POS tagging; Hidden markov models; Support vector machine; Neural networks; Gene expression programming;
D O I
10.1007/s10772-016-9356-2
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In natural language processing, a crucial subsystem in a wide range of applications is a part-of-speech (POS) tagger, which labels (or classifies) unannotated words of natural language with POS labels corresponding to categories such as noun, verb or adjective. Mainstream approaches are generally corpus-based: a POS tagger learns from a corpus of pre-annotated data how to correctly tag unlabeled data. Presented here is a brief state-of-the-art account on POS tagging. POS tagging approaches make use of labeled corpus to train computational trained models. Several typical models of three kings of tagging are introduced in this article: rule-based tagging, statistical approaches and evolution algorithms. The advantages and the pitfalls of each typical tagging are discussed and analyzed. Some rule-based and stochastic methods have been successfully achieved accuracies of 93-96 %, while that of some evolution algorithms are about 96-97 %.
引用
收藏
页码:647 / 654
页数:8
相关论文
共 52 条
  • [11] CUTTING D, 1992, THIRD CONFERENCE ON APPLIED NATURAL LANGUAGE PROCESSING, P133
  • [12] Dan Garrette, 2013, P 2013 C N AM ASS CO, V38, P129
  • [13] DAVIS MW, 1995, COM ADAP SY, P175
  • [14] Ferreira C, 2003, ADVANCES IN SOFT COMPUTING: ENGINEERING DESIGN AND MANUFACTURING, P257
  • [15] Ferreira C., 2001, CS0102027 ARXIV
  • [16] Gimenez Jesus, 2004, P 4 INT C LANG RES E
  • [17] Goldberg D., 1989, GENETIC ALGORITHMS S
  • [18] Greene B., 1979, AUTOMATED GRAMMATICA
  • [19] Jamatia A., 2015, P INT C REC ADV NAT, P239
  • [20] Efficient Evolution of Accurate Classification Rules Using a Combination of Gene Expression Programming and Clonal Selection
    Karakasis, Vasileios K.
    Stafylopatis, Andreas
    [J]. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2008, 12 (06) : 662 - 678