Evaluation of English to Arabic Machine Translation Systems using BLEU and GTM

被引:5
作者
Al-Rukban, Aljoharah [1 ]
Saudagar, Abdul Khader Jilani [1 ]
机构
[1] Al Imam Mohammad Ibn Saud Islamic Univ IMSIU, Coll Comp & Informat Sci, Informat Syst Dept, Riyadh, Saudi Arabia
来源
PROCEEDINGS OF THE 9TH INTERNATIONAL CONFERENCE ON EDUCATION TECHNOLOGY AND COMPUTERS (ICETC 2017) | 2017年
关键词
Accuracy; Arabic; BLEU; English; Evaluation; GTM; Machine Translation System; Translate;
D O I
10.1145/3175536.3175570
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The aim of this research study is to compare the effectiveness of three systems: Google Translator, Bing Translator and Golden Alwafi that are used to translate the corpus sentences from English language to Arabic language and then evaluate these sentences using two automatic evaluation methods viz., BLEU (Bilingual Evaluation Understudy) which is one of the most popular evaluation method and GTM (General Text Matcher) which is based on Recall, Precision, and F-measure. The scores obtained from the evaluation methods determine which one of these translation systems provides better translation. Higher the score means better translation and highly correlate with human translation. The results of this research study have revealed that Golden Alwafi achieves highest accuracy using BLEU and Google Translator attains highest accuracy with GTM method.
引用
收藏
页码:228 / 232
页数:5
相关论文
共 10 条
[1]  
Al-Kabi MN, 2013, INT J ADV COMPUT SC, V4, P66
[2]  
Bassnett Susan., 2014, Translation Studies, V4th
[3]  
Gupta V, 2013, 2013 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATIONS AND INFORMATICS (ICACCI), P1520, DOI 10.1109/ICACCI.2013.6637405
[4]  
Hailat T, 2013, P INT C APPL EL ENG, DOI [10.1109/AEECT.2013.6716439, DOI 10.1109/AEECT.2013.6716439]
[5]  
Kalyani Aditi, 2014, INT J ADV COMPUTER R, V4, P54
[6]   BLEU: a method for automatic evaluation of machine translation [J].
Papineni, K ;
Roukos, S ;
Ward, T ;
Zhu, WJ .
40TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE CONFERENCE, 2002, :311-318
[7]  
Qin Y, 2009, P NAT LANG PROC KNOW, DOI [10.1109/NLPKE.2009.5313751, DOI 10.1109/NLPKE.2009.5313751]
[8]   Textual Entailment Using Different Similarity Metrics [J].
Saikh, Tanik ;
Naskar, Sudip Kumar ;
Giri, Chandan ;
Bandyopadhyay, Sivaji .
COMPUTATIONAL LINGUISTICS AND INTELLIGENT TEXT PROCESSING (CICLING 2015), PT I, 2015, 9041 :491-501
[9]  
Trujillo Arturo., 1999, TRANSLATION ENGINES
[10]  
Turian J. P., 2006, EVALUATION MACHINE T