Evaluation of an Arabic Chatbot Based on Extractive Question-Answering Transfer Learning and Language Transformers

被引:4
作者
Alruqi, Tahani N. [1 ]
Alzahrani, Salha M. [1 ]
机构
[1] Taif Univ, Coll Comp & Informat Technol, Dept Comp Sci, POB 11099, Taif 21944, Saudi Arabia
关键词
Arabic; chatbot; transfer learning; AraBERT; CAMeLBERT; AarElectra (Generator/Discriminator); AraElectra-SQuAD; DEEP; DESIGN;
D O I
10.3390/ai4030035
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Chatbots are programs with the ability to understand and respond to natural language in a way that is both informative and engaging. This study explored the current trends of using transformers and transfer learning techniques on Arabic chatbots. The proposed methods used various transformers and semantic embedding models from AraBERT, CAMeLBERT, AraElectra-SQuAD, and AraElectra (Generator/Discriminator). Two datasets were used for the evaluation: one with 398 questions, and the other with 1395 questions and 365,568 documents sourced from Arabic Wikipedia. Extensive experimental works were conducted, evaluating both manually crafted questions and the entire set of questions by using confidence and similarity metrics. Our experimental results demonstrate that combining the power of transformer architecture with extractive chatbots can provide more accurate and contextually relevant answers to questions in Arabic. Specifically, our experimental results showed that the AraElectra-SQuAD model consistently outperformed other models. It achieved an average confidence score of 0.6422 and an average similarity score of 0.9773 on the first dataset, and an average confidence score of 0.6658 and similarity score of 0.9660 on the second dataset. The study concludes that the AraElectra-SQuAD showed remarkable performance, high confidence, and robustness, which highlights its potential for practical applications in natural language processing tasks for Arabic chatbots. The study suggests that the language transformers can be further enhanced and used for various tasks, such as specialized chatbots, virtual assistants, and information retrieval systems for Arabic-speaking users.
引用
收藏
页码:667 / 691
页数:25
相关论文
共 66 条
[1]   Chatbots: History, technology, and applications [J].
Adamopoulou, Eleni ;
Moussiades, Lefteris .
MACHINE LEARNING WITH APPLICATIONS, 2020, 2
[2]  
Ahmed A., 2022, COMPUT METH PROG BIO, V2, DOI [10.1016/j.cmpbup.2022.100057, DOI 10.1016/J.CMPBUP.2022.100057]
[3]  
Aksu Ibrahim Taha, 2021, Increasing Naturalness and Flexibility in Spoken Dialogue Interaction. 10th International Workshop on Spoken Dialogue Systems. Lecture Notes in Electrical Engineering (LNEE 714), P239, DOI 10.1007/978-981-15-9323-9_20
[4]  
Al-Ghadhban D, 2020, INT J ADV COMPUT SC, V11, P452
[5]   A Novel Framework for Arabic Dialect Chatbot Using Machine Learning [J].
Alhassan, Nadrh Abdullah ;
Albarrak, Abdulaziz Saad ;
Bhatia, Surbhi ;
Agarwal, Parul .
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
[6]  
Ali A. A., 2019, Asian Journal of Research in Computer Science, V2, P1, DOI [10.9734/ajrcos/2019/v4i230108, DOI 10.9734/AJRCOS/2018/V2I430080]
[7]  
Ali D., 2016, COLING (System Demonstrations), P208
[8]  
Aljawarneh E., ARABIC QUESTIONS DAT
[9]  
Almurayh A., 2021, IAENG Int. J. Comput. Sci., V48, P190
[10]   ArRASA: Channel Optimization for Deep Learning-Based Arabic NLU Chatbot Framework [J].
Alruily, Meshrif .
ELECTRONICS, 2022, 11 (22)