A neural reordering model based on phrasal dependency tree for statistical machine translation

被引:4
|
作者
Farzi, Saeed [1 ]
Faili, Heshaam [2 ]
Kianian, Sahar [3 ]
机构
[1] KN Toosi Univ Technol, Fac Comp Engn, Tehran, Iran
[2] Univ Tehran, Sch Elect & Comp Engn, Tehran, Iran
[3] Shahid Rajaee Teacher Training Univ, Fac Comp Engn, Tehran, Iran
关键词
Phrasal dependency tree; reordering model; artificial neural network; statistical machine translation;
D O I
10.3233/IDA-173582
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Machine translation is an important field of research and development. Word reordering is one of the main problems in machine translation. It is an important factor of quality and efficiency of machine translations and becomes more difficult when it deals with structurally divergent language pairs. To overcome this problem, we introduce a neural reordering model, using phrasal dependency trees which depict dependency relations among contiguous non-syntactic phrases. The model makes the use of reordering rules, which are automatically learned by a probabilistic neural network classifier from a reordered phrasal dependency tree bank. The proposed model combines the power of the lexical reordering and syntactic pre-ordering models by performing long-distance reorderings. The proposed reordering model is integrated into a standard phrase-based statistical machine translation system to translate input sentences. Our method is evaluated on syntactically divergent language-pairs, English -> Persian and English -> German using WMT07 benchmark. The results illustrate the superiority of the proposed method in terms of BLEU, TER and LRscore on both translation tasks. On average the proposed method retrieves a significant impact on precision and recall values respect to the hierarchical, lexicalized and distortion reordering models.
引用
收藏
页码:1163 / 1183
页数:21
相关论文
共 50 条
  • [21] A Unified Model for Soft Linguistic Reordering Constraints in Statistical Machine Translation
    Li, Junhui
    Marton, Yuval
    Resnik, Philip
    Daume, Hal, III
    PROCEEDINGS OF THE 52ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1, 2014, : 1123 - 1133
  • [22] Reordering space design in statistical machine translation
    Pecheux, Nicolas
    Allauzen, Alexandre
    Niehues, Jan
    Yvon, Francois
    LANGUAGE RESOURCES AND EVALUATION, 2016, 50 (02) : 375 - 410
  • [23] Reordering space design in statistical machine translation
    Nicolas Pécheux
    Alexandre Allauzen
    Jan Niehues
    François Yvon
    Language Resources and Evaluation, 2016, 50 : 375 - 410
  • [24] Improving tree-based neural machine translation with dynamic lexicalized dependency encoding
    Yang, Baosong
    Wong, Derek F.
    Chao, Lidia S.
    Zhang, Min
    KNOWLEDGE-BASED SYSTEMS, 2020, 188
  • [25] Non-projective Dependency-based Pre-Reordering with Recurrent Neural Network for Machine Translation
    Miceli-Barone, Antonio Valerio
    Attardi, Giuseppe
    PROCEEDINGS OF THE 53RD ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 7TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING, VOL 1, 2015, : 846 - 856
  • [26] Distributional Phrasal Paraphrase Generation for Statistical Machine Translation
    Marton, Yuval
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2013, 4 (03)
  • [27] A reordering model for phrase-based machine translation
    Nguyen, Vinh Van
    Nguyen, Thai Phuong
    Shimazu, Akira
    Nguyen, Minh Le
    ADVANCES IN NATURAL LANGUAGE PROCESSING, PROCEEDINGS, 2008, 5221 : 476 - +
  • [28] Distributional phrasal paraphrase generation for statistical machine translation
    Marton, Y. (yuvalmarton@gmail.com), 1600, Association for Computing Machinery, 2 Penn Plaza, Suite 701, New York, NY 10121-0701, United States (43):
  • [29] A Reordering Model Based on Shallow Parsing for Improving Phrase-Based Statistical Machine Translation Systems
    Chen, Yidong
    Shi, Xiaodong
    Zhou, Changle
    Hong, Qingyang
    INFORMATION-AN INTERNATIONAL INTERDISCIPLINARY JOURNAL, 2009, 12 (02): : 297 - 309
  • [30] Lexicalized reordering in multiple-graph based statistical machine translation
    Zhou, Bowen
    Zhang, Rong
    Gao, Yuqing
    2008 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-12, 2008, : 4981 - 4984