Improving Word Alignment Through Morphological Analysis

被引:0
|
作者
Vuong Van Bui [1 ]
Thanh Trung Tran [1 ]
Nhat Bich Thi Nguyen [1 ]
Tai Dinh Pham [1 ]
Anh Ngoc Le [1 ]
Cuong Anh Le [1 ]
机构
[1] Univ Engn & Technol, Vietnam Natl Univ, Dept Comp Sci, Hanoi, Vietnam
来源
INTEGRATED UNCERTAINTY IN KNOWLEDGE MODELLING AND DECISION MAKING, IUKM 2015 | 2015年 / 9376卷
关键词
Machine translation; Word alignment; IBM models; Morphological analysis;
D O I
10.1007/978-3-319-25135-6_30
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Word alignment plays a critical role in statistical machine translation systems. The famous word alignment system, IBM models series, currently operates on only surface forms of words regardless of their linguistic features. This deficiency usually leads to many data sparseness problems. Therefore, we present an extension that enables the integration of morphological analysis into the traditional IBM models. Experiments on English-Vietnamese tasks show that the new model produces better results not only in word alignment but also in final translation performance.
引用
收藏
页码:315 / 325
页数:11
相关论文
共 50 条
  • [21] English-Lithuanian Word Alignment with Bilingwis: Evaluation of the Alignment
    Boizou, Loic
    Kovalevskaite, Jolanta
    Rimkute, Erika
    Wechsler, Roger
    HUMAN LANGUAGE TECHNOLOGIES - THE BALTIC PERSPECTIVE, BALTIC HLT 2014, 2014, 268 : 61 - +
  • [22] Syntactic Pattern Based Word Alignment for Statistical Machine Translation
    Le, Quang-Hung
    Le, Anh-Cuong
    INTERNATIONAL JOURNAL OF KNOWLEDGE AND SYSTEMS SCIENCE, 2014, 5 (03) : 36 - 45
  • [23] Application of Word Alignment for Supporting Translation of Japanese Statutes into English
    Katsuhiko, Toyama
    Yasuhiro, Ogawa
    Kazuhiro, Imai
    Yoshiharu, Matsuura
    LEGAL KNOWLEDGE AND INFORMATION SYSTEMS, 2006, 152 : 141 - 150
  • [24] A Word Segmentation Method of Ancient Chinese Based on Word Alignment
    Che, Chao
    Zhao, Hanyu
    Wu, Xiaoting
    Zhou, Dongsheng
    Zhang, Qiang
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING (NLPCC 2019), PT I, 2019, 11838 : 761 - 772
  • [25] Towards Better Word Alignment in Transformer
    Song, Kai
    Zhou, Xiaoqing
    Yu, Heng
    Huang, Zhongqiang
    Zhang, Yue
    Luo, Weihua
    Duan, Xiangyu
    Zhang, Min
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2020, 28 : 1801 - 1812
  • [26] Hypothesis Pruning in Learning Word Alignment
    Huang Shujian
    Dai Xinyu
    Chen Jiajun
    CHINESE JOURNAL OF ELECTRONICS, 2013, 22 (01): : 93 - 98
  • [27] Word Alignment Based Transformer Model for XML Structured Documentation Translation
    An, Jing
    Tang, Yecheng
    Bai, Yanbing
    Li, Jiyi
    DATABASE AND EXPERT SYSTEMS APPLICATIONS, DEXA 2022, PT I, 2022, 13426 : 316 - 322
  • [28] Learning Word Alignment Models for Kazakh-English Machine Translation
    Kartbayev, Amandyk
    INTEGRATED UNCERTAINTY IN KNOWLEDGE MODELLING AND DECISION MAKING, IUKM 2015, 2015, 9376 : 326 - 335
  • [29] Iteratively constrained selection of word alignment links using knowledge and statistics
    Lee, Jonghoon
    Lee, Sungjin
    Noh, Hyeongjong
    Lee, Kyusong
    Lee, Gary Geunbae
    KNOWLEDGE-BASED SYSTEMS, 2011, 24 (07) : 1120 - 1130
  • [30] Improving syntactic rule extraction through deleting spurious links with translation span alignment
    Zhu, Jingbo
    Li, Qiang
    Xiao, Tong
    NATURAL LANGUAGE ENGINEERING, 2015, 21 (02) : 227 - 249