Improving Language Translation Using the Hidden Markov Model

被引:5
作者
Chang, Yunpeng [1 ]
Wang, Xiaoliang [1 ]
Xue, Meihua [1 ]
Liu, Yuzhen [1 ]
Jiang, Frank [2 ]
机构
[1] Hunan Univ Sci & Technol, Sch Comp Sci & Engn, Xiang 411201, Peoples R China
[2] Deakin Univ, Sch Info Technol, Geelong, Vic 3220, Australia
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2021年 / 67卷 / 03期
基金
湖南省自然科学基金;
关键词
Translation software; hidden Markov model; context translation;
D O I
10.32604/cmc.2021.012304
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Translation software has become an important tool for communication between different languages. People's requirements for translation are higher and higher, mainly reflected in people's desire for barrier free cultural exchange. With a large corpus, the performance of statistical machine translation based on words and phrases is limited due to the small size of modeling units. Previous statistical methods rely primarily on the size of corpus and number of its statistical results to avoid ambiguity in translation, ignoring context. To support the ongoing improvement of translation methods built upon deep learning, we propose a translation algorithm based on the Hidden Markov Model to improve the use of context in the process of translation. During translation, our Hidden Markov Model prediction chain selects a number of phrases with the highest result probability to form a sentence. The collection of all of the generated sentences forms a topic sequence. Using probabilities and article sequences determined from the training set, our method again applies the Hidden Markov Model to form the final translation to improve the context relevance in the process of translation. This algorithm improves the accuracy of translation, avoids the combination of invalid words, and enhances the readability and meaning of the resulting translation.
引用
收藏
页码:3921 / 3931
页数:11
相关论文
共 21 条
[1]  
[Anonymous], 2015, P 3 INT C LEARN REPR
[2]  
Bahdanau D., 2015, P ICLR2015 SAN DIEG
[3]  
Bapna A., 2018, P EMNLP BRUSS BELG
[4]   Neural Machine Translation With Sentence-Level Topic Context [J].
Chen, Kehai ;
Wang, Rui ;
Utiyama, Masao ;
Sumita, Eiichiro ;
Zhao, Tiejun .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2019, 27 (12) :1970-1984
[5]   Discriminative ridge regression algorithm for adaptation in statistical machine translation [J].
Chinea-Rios, Mara ;
Sanchis-Trilles, German ;
Casacuberta, Francisco .
PATTERN ANALYSIS AND APPLICATIONS, 2019, 22 (04) :1293-1305
[6]  
Dou Z. Y., 2018, P EMNLP BRUSS BELG
[7]  
Feng Z., 2018, J. Foreign Lang, V41, P35
[8]  
He H. H., 2018, EXPERT SYST, V36, P131
[9]  
Iyyer M., 2014, P EMNLP DOH QAT
[10]   Deep Reinforcement Learning for Resource Protection and Real-Time Detection in IoT Environment [J].
Liang, Wei ;
Huang, Weihong ;
Long, Jing ;
Zhang, Ke ;
Li, Kuan-Ching ;
Zhang, Dafang .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (07) :6392-6401