AI-based Arabic Language and Speech Tutor

被引:2
作者
Shao, Sicong [1 ]
Alharir, Saleem [1 ]
Hariri, Salim [1 ]
Satam, Pratik [2 ]
Shiri, Sonia [3 ]
Mbarki, Abdessamad [3 ]
机构
[1] Univ Arizona, NSF Ctr Cloud & Auton Comp, Tucson, AZ 85721 USA
[2] Univ Arizona, Dept Syst & Ind Engn, Tucson, AZ 85721 USA
[3] Univ Arizona, Sch Middle Eastern & North African Studies, Arab Special Programs, Tucson, AZ 85721 USA
来源
2022 IEEE/ACS 19TH INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS AND APPLICATIONS (AICCSA) | 2022年
基金
美国国家科学基金会;
关键词
Automatic speech recognition; computer-assisted second language learning; deep learning; LSTM; attention mechanism; NEURAL-NETWORKS;
D O I
10.1109/AICCSA56895.2022.10017924
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the past decade, we have observed a growing interest in using technologies such as artificial intelligence (AI), machine learning, and chatbots to provide assistance to language learners, especially in second language learning. By using AI and natural language processing (NLP) and chatbots, we can create an intelligent self-learning environment that goes beyond multiple-choice questions and/or fill in the blank exercises. In addition, NLP allows for learning to be adaptive in that it offers more than an indication that an error has occurred. It also provides a description of the error, uses linguistic analysis to isolate the source of the error, and then suggests additional drills to achieve optimal individualized learning outcomes. In this paper, we present our approach for developing an Artificial Intelligence-based Arabic Language and Speech Tutor (AI-ALST) for teaching the Moroccan Arabic dialect. The AI-ALST system is an intelligent tutor that provides analysis and assessment of students learning the Moroccan dialect at University of Arizona (UA). The AI-ALST provides a self-learned environment to practice each lesson for pronunciation training. In this paper, we present our initial experimental evaluation of the AI-ALST that is based on MFCC (Mel frequency cepstrum coefficient) feature extraction, bidirectional LSTM (Long Short-Term Memory), attention mechanism, and a cost-based strategy for dealing with class-imbalance learning. We evaluated our tutor on the word pronunciation of lesson 1 of the Moroccan Arabic dialect class. The experimental results show that the AI-ALST can effectively and successfully detect pronunciation errors and evaluate its performance by using F-1 - score, accuracy, precision, and recall.
引用
收藏
页数:8
相关论文
共 27 条
[1]  
Ahmed A., 2022, COMPUTER METHODS PRO
[2]  
Al-Ghadhban D, 2020, INT J ADV COMPUT SC, V11, P452
[3]  
Ali D. A., 2016, INT C COMPUTATIONAL
[4]  
[Anonymous], 2014, Artificial intelligence and tutoring systems: Computational and cognitive approaches to the communication of knowledge
[5]  
Bahdanau D., 2015, ICLR
[6]  
Bang J., 2014, CLIMATE CHANGE 2014, V13, P1
[7]  
Diment A., 2019, IEEE IJCNN, P1
[8]  
Fouz-Gonzlez J., 2015, Investigating English pronunciation: Trends and directions, P314, DOI DOI 10.1057/978113750943714
[9]  
Fryer L, 2006, LANG LEARN TECHNOL, V10, P8
[10]  
Greer J.E., 2013, Student modelling: the key to individualized knowledge-based instruction, V125