Some Translation Studies informed suggestions for further balancing methodologies for machine translation quality evaluation

被引:4
作者
Kruger, Ralph [1 ]
机构
[1] TH Koln Univ Appl Sci, Cologne, Germany
关键词
machine translation quality evaluation; professional human translation; (super)human MT performance; MT bias; translation studies;
D O I
10.1075/ts.21026.kru
中图分类号
H [语言、文字];
学科分类号
05 ;
摘要
This article intends to contribute to the current debate on the quality of neural machine translation (NMT) vs. (professional) human translation quality, where recently claims concerning (super)human performance of NMT systems have emerged. The article will critically analyse some current machine translation (MT) quality evaluation methodologies employed in studies claiming such performance of their MT systems. This analysis aims to identify areas where these methodologies are potentially biased in favour of MT and hence may overvalue MT performance while undervaluing human translation performance. Then, the article provides some Translation Studies informed suggestions for improving or debiasing these methodologies in order to arrive at a more balanced picture of MT vs. (professional) human translation quality.
引用
收藏
页码:213 / 233
页数:21
相关论文
共 34 条
[1]  
ELIS, 2021, European Language Industry Survey
[2]  
ErgoTrans, 2015, FIN REP COGN PHYS ER
[3]   Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation [J].
Freitag, Markus ;
Foster, George ;
Grangier, David ;
Ratnakar, Viresh ;
Tan, Qijun ;
Macherey, Wolfgang .
TRANSACTIONS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, 2021, 9 :1460-1474
[4]  
Grice H. P., 1975, SYNTAX SEMANTICS, P41, DOI DOI 10.1163/9789004368811_003
[5]  
Hassan Hany, 2018, Achieving human parity on automatic Chinese to English news translation.
[6]  
HORN-HELF Brigitte., 1999, Technisches Ubersetzen in Theorie und Praxis
[7]  
House J., 2006, EUR J ENGL STUD, V10, P249, DOI [10.1080/13825570600967721, DOI 10.1080/13825570600967721]
[8]  
Kade O., 1968, Zufall und gesetzmassigkeit in der ubersetzung
[9]  
Koehn P., 2020, Neural Machine Translation, V1st, DOI DOI 10.1017/9781108608480
[10]   EXPLICITATION IN NEURAL MACHINE TRANSLATION [J].
Krueger, Ralph .
ACROSS LANGUAGES AND CULTURES, 2020, 21 (02) :195-216