Improving paraphrase generation using supervised neural-based statistical machine translation framework

被引:2
作者
Razaq, Abdur [1 ,3 ]
Shah, Babar [2 ,3 ]
Khan, Gohar [2 ,3 ]
Alfandi, Omar [2 ,3 ]
Ullah, Abrar [2 ,3 ]
Halim, Zahid [1 ,3 ]
Ur Rahman, Atta [1 ,3 ]
机构
[1] Ghulam Ishaq Khan Inst Engn Sci & Technol, Topi, Pakistan
[2] Zayed Univ, Coll Technol Innovat, Abu Dhabi, U Arab Emirates
[3] Heriot Watt Univ, Dubai, U Arab Emirates
关键词
Phrase generation; Neural machine translation; Statistical machine translation; Neural-based statistical machine translation;
D O I
10.1007/s00521-023-08830-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In phrase generation (PG), a sentence in the natural language is changed into a new one with a different syntactic structure but having the same semantic meaning. The present sequence-to-sequence strategy aims to recall the words and structures from the training dataset rather than learning the words' semantics. As a result, the resulting statements are frequently grammatically accurate but incorrect linguistically. The neural machine translation approach suffers to handle unusual words, domain mismatch, and unfamiliar words, but it takes context well. This work presents a novel model for creating paraphrases that use neural-based statistical machine translation (NSMT). Our approach creates potential paraphrases for any source input, calculates the level of semantic similarity between text segments of any length, and encodes paraphrases in a continuous space. To evaluate the suggested model, Quora Question Pair and Microsoft Common Objects in Context benchmark datasets are used. We demonstrate that the proposed technique achieves cutting-edge performance on both datasets using automatic and human assessments. Experimental findings across tasks and datasets demonstrate that the suggested NSMT-based PG outperforms those achieved with traditional phrase-based techniques. We also show that the proposed technique may be used automatically for the development of paraphrases for a variety of languages.
引用
收藏
页码:7705 / 7719
页数:15
相关论文
共 49 条
[1]   Quora Question Answer Dataset [J].
Aghaebrahimian, Ahmad .
TEXT, SPEECH, AND DIALOGUE, TSD 2017, 2017, 10415 :66-73
[2]  
[Anonymous], 2012, P COLING 2012
[3]   Statistical-based system combination approach to gain advantages over different machine translation systems [J].
Banik, Debajyoty ;
Ekbal, Asif ;
Bhattacharyya, Pushpak ;
Bhattacharyya, Siddhartha ;
Platos, Jan .
HELIYON, 2019, 5 (09)
[4]   Semantic Parsing via Paraphrasing [J].
Berant, Jonathan ;
Liang, Percy .
PROCEEDINGS OF THE 52ND ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1, 2014, :1415-1425
[5]  
Bolshakov IA, 2004, LECT NOTES COMPUT SC, V3136, P312
[6]  
Cao D, 2016, 2016 2ND IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATIONS (ICCC), P2749, DOI 10.1109/CompComm.2016.7925198
[7]  
Chen Wenqing, 2020, P 28 INT C COMPUTAT, P1186
[8]  
Chevelu J., 2010, COLING, V2010, P9
[9]  
Cho KYHY, 2014, Arxiv, DOI [arXiv:1406.1078, DOI 10.48550/ARXIV.1406.1078]
[10]   Developing a Twitter-based traffic event detection model using deep learning architectures [J].
Dabiri, Sina ;
Heaslip, Kevin .
EXPERT SYSTEMS WITH APPLICATIONS, 2019, 118 :425-439