Maximum Entropy Combined FSM Stemming Method for Uyghur

被引:1
|
作者
Wumaier, Aishan [1 ]
Kadeer, Zaokere [1 ]
Tursun, Panda [1 ]
Tian, Shengwei [1 ]
机构
[1] Xinjiang Univ, Sch Informat Sci & Engn, Urumqi 830046, Xinjiang, Peoples R China
关键词
Uyghur; stemming; FSM; Maximum Entropy;
D O I
10.1109/ICSDA.2009.5278378
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents the generation of Uyghur Noun Suffix DFA combined with Maximum Entropy (MaxEnt) for stemming algorithm. Because of the agglutinative nature of Uyghur language, stemming is an essential task for Uyghur language processing applications. We generate Uyghur noun inflectional suffixes finite state machines (FSMs) by using the morphotactic rules in reverse order. But there are eight suffixes which is similar to the ending part of some words. These suffixes make the FSM ambiguous. We apply the MaxEnt model to resolve ambiguity of the FSM. This paper describes the steps of generating the FSM, building the MaxEnt suffix identifying model and combination of MaxEnt with FSM.
引用
收藏
页码:51 / 55
页数:5
相关论文
共 50 条
  • [1] Conditional Random Fields Combined FSM Stemming Method for Uyghur
    Wumaier, Aishan
    Yibulayin, Tuergen
    Kadeer, Zaokere
    Tian, Shengwei
    2009 2ND IEEE INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND INFORMATION TECHNOLOGY, VOL 3, 2009, : 295 - 299
  • [2] A survey on the methods for uyghur stemming
    Mahmoud, Abdurahim
    Dawut, Abdusalam
    Tursun, Peride
    Hamdulla, Askar
    International Journal of Control and Automation, 2016, 9 (11): : 143 - 158
  • [3] UYGHUR NAMED ENTITY IDENTIFICATION BASING ON MAXIMUM ENTROPY MODEL
    Yong, Yang
    Chun, Xu
    Awudan, Gulimire
    3RD INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND COMPUTER SCIENCE (ITCS 2011), PROCEEDINGS, 2011, : 327 - 330
  • [4] A combined reliability analysis approach with dimension reduction method and maximum entropy method
    Li, Gang
    Zhang, Kai
    STRUCTURAL AND MULTIDISCIPLINARY OPTIMIZATION, 2011, 43 (01) : 121 - 134
  • [5] A combined reliability analysis approach with dimension reduction method and maximum entropy method
    Gang Li
    Kai Zhang
    Structural and Multidisciplinary Optimization, 2011, 43 : 121 - 134
  • [6] MAXIMUM ENTROPY METHOD
    KREINOVIC, VJ
    KOSHELEVA, OM
    NATURE, 1979, 281 (5733) : 708 - 709
  • [7] Maximum entropy method
    不详
    DISPERSION, COMPLEX ANALYSIS AND OPTICAL SPECTROSCOPY, 1999, 147 : 79 - 95
  • [8] Combined analysis of steady state and transient transport by the maximum entropy method
    Giannone, L
    Stroth, U
    Kollermeyer, J
    Alexander, M
    Erckmann, V
    Hartfuss, HJ
    Ryter, F
    Suttrop, W
    PLASMA PHYSICS AND CONTROLLED FUSION, 1996, 38 (04) : 477 - 488
  • [9] A Relationship between the Ordinary Maximum Entropy Method and the Method of Maximum Entropy in the Mean
    Gzyl, Henryk
    ter Horst, Enrique
    ENTROPY, 2014, 16 (02): : 1123 - 1133
  • [10] Uyghur Noun Suffix Finite State Machine for Stemming
    Wumaier, Aishan
    Tursun, Parida
    Kadeer, Zaokere
    Yibulayin, Tuergen
    2009 2ND IEEE INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND INFORMATION TECHNOLOGY, VOL 5, 2009, : 161 - +