Evaluation of Machine Translation Output in Context of Inflectional Languages

被引：0
|
作者：
Munkova, Dasa [1 ]
Kapusta, Jozef [2 ]
Munk, Michal [2 ]
Reichel, Jaroslav [2 ]
机构：
[1] Constantine Philosopher Univ Nitra, Dept Translat Studies, Nitra, Slovakia
[2] Constantine Philosopher Univ Nitra, Dept Informat, Nitra, Slovakia
来源：
2016 IEEE 10TH INTERNATIONAL CONFERENCE ON APPLICATION OF INFORMATION AND COMMUNICATION TECHNOLOGIES (AICT) | 2016年
关键词：
Manual evaluation; Automatic evaluation; Inflectional language; Natural language processing;
D O I：
暂无
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Objective of the paper is to evaluate metrics of automatic evaluation of machine translation output using manual metrics - fluency and adequacy. We tried to answer the question to which extent the manual evaluation correlates with the automatic evaluation of MT output from/to Slovak to/from English. We focused on metrics based on the similarity and statistical principles (WER, PER, CDER and BLEU-n). We found out, that the manual evaluation, namely fluency and adequacy metrics correlates with automatic metrics of MT evaluation for less spoken language and low resource language such as Slovak. The contribution also consists of system proposal for both, manual (based on POS tagging) and automatic (based on reference) evaluation of MT output.
引用
收藏
页码：85 / 89
页数：5
相关论文
共 50 条
  • [21] Metric for Evaluation of Machine Translation Quality on the bases of Edit Distances and Reverse Translation
    Kornilov, V. S.
    Glushan, V. M.
    Lozovoy, A. Yu
    2021 IEEE 15TH INTERNATIONAL CONFERENCE ON APPLICATION OF INFORMATION AND COMMUNICATION TECHNOLOGIES (AICT2021), 2021,
  • [22] Finite-State Transducers with Multivalued Mappings for Processing of Rich Inflectional Languages
    Tukeyev, Ualsher
    Milosz, Marek
    Zhumanov, Zhandos
    NEW TRENDS IN INTELLIGENT INFORMATION AND DATABASE SYSTEMS, 2015, 598 : 271 - 280
  • [23] Evaluation of Machine Translation Approaches to Translate English to Bengali
    Nahar, Shamsun
    Huda, Mohammad Nurul
    Nur-E-Arefin, Md.
    Rahman, Mohammad Mahbubur
    2017 20TH INTERNATIONAL CONFERENCE OF COMPUTER AND INFORMATION TECHNOLOGY (ICCIT), 2017,
  • [24] A Comparative Study and Analysis of Evaluation Matrices in Machine Translation
    Shukla, Maitry B.
    Chavada, Bhoomika
    PROCEEDINGS OF THE 2019 6TH INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT (INDIACOM), 2019, : 1236 - 1239
  • [25] Linguistically enhanced word segmentation for better neural machine translation of low resource agglutinative languages
    Chimalamarri, Santwana
    Sitaram, Dinkar
    INTERNATIONAL JOURNAL OF SPEECH TECHNOLOGY, 2021, 24 (04) : 1047 - 1053
  • [26] The Use of Machine Translation to Provide Resources for Under-Resourced Languages - Image Captioning Task
    Ahmed, Basem H.
    Saad, Motaz
    2021 PALESTINIAN INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY (PICICT 2021), 2021, : 25 - 29
  • [27] Linguistically enhanced word segmentation for better neural machine translation of low resource agglutinative languages
    Santwana Chimalamarri
    Dinkar Sitaram
    International Journal of Speech Technology, 2021, 24 : 1047 - 1053
  • [28] Machine translation considering context informaiton using Encoder-Decoder model
    Takano, Tetsuto
    Yamane, Satoshi
    2018 IEEE 42ND ANNUAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE (COMPSAC), VOL 1, 2018, : 793 - 794
  • [29] Routing Based Context Selection for Document-Level Neural Machine Translation
    Fei, Weilun
    Jian, Ping
    Zhu, Xiaoguang
    Lin, Yi
    MACHINE TRANSLATION, CCMT 2021, 2021, 1464 : 77 - 91
  • [30] A deep source-context feature for lexical selection in statistical machine translation
    Gupta, Parth
    Costa-Jussa, Marta R.
    Rosso, Paolo
    Banchs, Rafael E.
    PATTERN RECOGNITION LETTERS, 2016, 75 : 24 - 29
12345