Maximum Entropy Combined FSM Stemming Method for Uyghur

被引:1
|
作者
Wumaier, Aishan [1 ]
Kadeer, Zaokere [1 ]
Tursun, Panda [1 ]
Tian, Shengwei [1 ]
机构
[1] Xinjiang Univ, Sch Informat Sci & Engn, Urumqi 830046, Xinjiang, Peoples R China
关键词
Uyghur; stemming; FSM; Maximum Entropy;
D O I
10.1109/ICSDA.2009.5278378
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents the generation of Uyghur Noun Suffix DFA combined with Maximum Entropy (MaxEnt) for stemming algorithm. Because of the agglutinative nature of Uyghur language, stemming is an essential task for Uyghur language processing applications. We generate Uyghur noun inflectional suffixes finite state machines (FSMs) by using the morphotactic rules in reverse order. But there are eight suffixes which is similar to the ending part of some words. These suffixes make the FSM ambiguous. We apply the MaxEnt model to resolve ambiguity of the FSM. This paper describes the steps of generating the FSM, building the MaxEnt suffix identifying model and combination of MaxEnt with FSM.
引用
收藏
页码:51 / 55
页数:5
相关论文
共 50 条
  • [31] Maximum entropy method for diffractive imaging
    Shioya, Hiroyuki
    Gohara, Kazutoshi
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2008, 25 (11) : 2846 - 2850
  • [32] Maximum entropy method approach to the θ term
    Imachi, M
    Shinno, Y
    Yoneyama, H
    PROGRESS OF THEORETICAL PHYSICS, 2004, 111 (03): : 387 - 411
  • [33] THE MAXIMUM-ENTROPY METHOD IN NMR
    MARTIN, JF
    JOURNAL OF MAGNETIC RESONANCE, 1985, 65 (02) : 291 - 297
  • [34] The maximum-entropy method in superspace
    van Smaalen, S
    Palatinus, L
    Schneider, M
    ACTA CRYSTALLOGRAPHICA A-FOUNDATION AND ADVANCES, 2003, 59 : 459 - 469
  • [35] Deconvolution by the multiscale maximum entropy method
    Starck, JL
    Pantin, E
    ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS V, 1996, 101 : 191 - 194
  • [36] Validity limits of the maximum entropy method
    Allahverdyan, A. E.
    Khalafyan, E. A.
    Martirosyan, N. H.
    CHINESE JOURNAL OF PHYSICS, 2021, 71 : 95 - 111
  • [37] A Maximum Entropy Method for Particle Filtering
    Gregory L. Eyink
    Sangil Kim
    Journal of Statistical Physics, 2006, 123 : 1071 - 1128
  • [38] ACCURACY OF THE MAXIMUM-ENTROPY METHOD
    STRAUSS, FM
    ASTRONOMY & ASTROPHYSICS, 1980, 81 (03) : 344 - 346
  • [39] Galerkin local maximum entropy method
    Dreier, Nils-Arne
    Engwer, Christian
    Hartmann, Dirk
    INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN FLUIDS, 2018, 88 (02) : 100 - 115
  • [40] A maximum entropy method for convex programming
    唐焕文
    张立卫
    Chinese Science Bulletin, 1995, (05) : 361 - 364