Maximum Entropy Combined FSM Stemming Method for Uyghur

被引:1
|
作者
Wumaier, Aishan [1 ]
Kadeer, Zaokere [1 ]
Tursun, Panda [1 ]
Tian, Shengwei [1 ]
机构
[1] Xinjiang Univ, Sch Informat Sci & Engn, Urumqi 830046, Xinjiang, Peoples R China
关键词
Uyghur; stemming; FSM; Maximum Entropy;
D O I
10.1109/ICSDA.2009.5278378
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents the generation of Uyghur Noun Suffix DFA combined with Maximum Entropy (MaxEnt) for stemming algorithm. Because of the agglutinative nature of Uyghur language, stemming is an essential task for Uyghur language processing applications. We generate Uyghur noun inflectional suffixes finite state machines (FSMs) by using the morphotactic rules in reverse order. But there are eight suffixes which is similar to the ending part of some words. These suffixes make the FSM ambiguous. We apply the MaxEnt model to resolve ambiguity of the FSM. This paper describes the steps of generating the FSM, building the MaxEnt suffix identifying model and combination of MaxEnt with FSM.
引用
收藏
页码:51 / 55
页数:5
相关论文
共 50 条
  • [41] Applications of the Maximum Entropy Method in superspace
    Van Smaalen, S
    Palatinus, L
    FERROELECTRICS, 2004, 305 : 57 - 62
  • [42] Applications of the maximum entropy method in crystallography
    Schneider, M
    Van Smaalen, S
    MAXIMUM ENTROPY AND BAYESIAN METHODS, 1999, 105 : 335 - 340
  • [43] A maximum entropy method for particle filtering
    Eyink, Gregory L.
    Kim, Sangil
    JOURNAL OF STATISTICAL PHYSICS, 2006, 123 (05) : 1071 - 1128
  • [44] Maximum Entropy Method in Comminution Modelling
    Henryk Otwinowski
    Granular Matter, 2006, 8 : 239 - 249
  • [45] Maximum entropy method for γ-convex programming
    Liu, Guozhi
    Cen, Xia
    Shiyou Huagong Gaodeng Xuexiao Xuebao/Journal of Petrochemical Universities, 1998, 11 (03): : 69 - 71
  • [47] Contagion in Chinese banking system: A comparison of maximum entropy method and transfer entropy method
    Liang, Changzhi
    Zhu, Xiaoqian
    Yao, Yanzhen
    Li, Jianping
    2014 SEVENTH INTERNATIONAL JOINT CONFERENCE ON COMPUTATIONAL SCIENCES AND OPTIMIZATION (CSO), 2014, : 474 - 478
  • [48] The Bayesian maximum entropy method for lognormal variables
    Orton, T. G.
    Lark, R. M.
    STOCHASTIC ENVIRONMENTAL RESEARCH AND RISK ASSESSMENT, 2009, 23 (03) : 319 - 328
  • [49] Test method with the maximum entropy and its application
    School of Electronic Information and Control Engineering, Beijing University of Technology, Beijing 100022, China
    不详
    Zidonghua Xuebao, 2007, 11 (1226-1228):
  • [50] Application of Maximum Entropy Method to Semiconductor Engineering
    Yonamoto, Yoshiki
    ENTROPY, 2013, 15 (05): : 1663 - 1689