Low-Resource Language Processing Using Improved Deep Learning with Hunter-Prey Optimization Algorithm

被引:0
作者
Al-Wesabi, Fahd N. [1 ]
Alshahrani, Hala J. [2 ]
Osman, Azza Elneil [3 ]
Abd Elhameed, Elmouez Samir [4 ]
机构
[1] King Khalid Univ, Coll Sci & Art Mahayil, Dept Comp Sci, Abha 62529, Saudi Arabia
[2] Princess Nourah Bint Abdulrahman Univ, Coll Languages, Dept Appl Linguist, POB 84428, Riyadh 11671, Saudi Arabia
[3] Prince Sattam Bin Abdulaziz Univ, Dept Comp & Self Dev, AlKharj 16278, Saudi Arabia
[4] Sudan Univ Sci & Technol, Coll Postgrad Studies, Dept Comp Sci, Khartoum 11111, Sudan
关键词
low-resource languages; natural language processing; deep learning; sentiment analysis; hunter-prey optimizer; SENTIMENT ANALYSIS;
D O I
10.3390/math11214493
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Low-resource language (LRL) processing refers to the development of natural language processing (NLP) techniques and tools for languages with limited linguistic resources and data. These languages often lack well-annotated datasets and pre-training methods, making traditional approaches less effective. Sentiment analysis (SA), which involves identifying the emotional tone or sentiment expressed in text, poses unique challenges for LRLs due to the scarcity of labelled sentiment data and linguistic intricacies. NLP tasks like SA, powered by machine learning (ML) techniques, can generalize effectively when trained on suitable datasets. Recent advancements in computational power and parallelized graphical processing units have significantly increased the popularity of deep learning (DL) approaches built on artificial neural network (ANN) architectures. With this in mind, this manuscript describes the design of an LRL Processing technique that makes use of Improved Deep Learning with Hunter-Prey Optimization (LRLP-IDLHPO). The LRLP-IDLHPO technique enables the detection and classification of different kinds of sentiments present in LRL data. To accomplish this, the presented LRLP-IDLHPO technique initially pre-processes these data to improve their usability. Subsequently, the LRLP-IDLHPO approach applies the SentiBERT approach for word embedding purposes. For the sentiment classification process, the Element-Wise-Attention GRU network (EWAG-GRU) algorithm is used, which is an enhanced version of the recurrent neural network. The EWAG-GRU model is capable of processing temporal features and includes an attention strategy. Finally, the performance of the EWAG-GRU model can be boosted by adding the HPO algorithm for use in the hyperparameter tuning process. A widespread simulation analysis was performed to validate the superior results derived from using the LRLP-IDLHPO approach. The extensive results indicate the significant superiority of the performance of the LRLP-IDLHPO technique compared to the state-of-the-art approaches described in the literature.
引用
收藏
页数:17
相关论文
共 50 条
[31]   Low-Resource Text Classification Using Domain-Adversarial Learning [J].
Griesshaber, Daniel ;
Ngoc Thang Vu ;
Maucher, Johannes .
STATISTICAL LANGUAGE AND SPEECH PROCESSING, SLSP 2018, 2018, 11171 :129-139
[32]   Application of deep learning fusion algorithm in natural language processing in emotional semantic analysis [J].
Gong, Yunlu ;
Lu, Nannan ;
Zhang, Jiajian .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2019, 31 (10)
[33]   Improving stance detection accuracy in low-resource languages: a deep learning framework with ParsBERT [J].
Rahimi, Mohammad ;
Kiani, Vahid .
INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS, 2024, :517-535
[34]   Fast compression and optimization of deep learning models for natural language processing [J].
Pietron, Marcin ;
Karwatowski, Michal ;
Wielgosz, Maciej ;
Duda, Jerzy .
2019 SEVENTH INTERNATIONAL SYMPOSIUM ON COMPUTING AND NETWORKING WORKSHOPS (CANDARW 2019), 2019, :162-168
[35]   Building large-scale registries from unstructured clinical notes using a low-resource natural language processing pipeline [J].
Tavabi, Nazgol ;
Pruneski, James ;
Golchin, Shahriar ;
Singh, Mallika ;
Sanborn, Ryan ;
Heyworth, Benton ;
Landschaft, Assaf ;
Kimia, Amir ;
Kiapour, Ata .
ARTIFICIAL INTELLIGENCE IN MEDICINE, 2024, 151
[36]   ACTIVE LEARNING FOR LOW-RESOURCE SPEECH RECOGNITION: IMPACT OF SELECTION SIZE AND LANGUAGE MODELING DATA [J].
Syed, Ali Raza ;
Rosenberg, Andrew ;
Mandel, Michael .
2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, :5315-5319
[37]   Deep learning-based hybrid sentiment analysis with feature selection using optimization algorithm [J].
Daniel, D. Anand Joseph ;
Meena, M. Janaki .
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (28) :43273-43296
[38]   Deep learning-based hybrid sentiment analysis with feature selection using optimization algorithm [J].
D. Anand Joseph Daniel ;
M. Janaki Meena .
Multimedia Tools and Applications, 2023, 82 :43273-43296
[39]   Deep-Hill: An Innovative Cloud Resource Optimization Algorithm by Predicting SaaS Instance Configuration Using Deep Learning [J].
Abouelyazid, Mahmoud .
IEEE ACCESS, 2024, 12 :92573-92584
[40]   A Deep Learning model for Question Analysis in Low-resource Languages: A Dataset and Case Study for Persian [J].
Khaksefidi, Fatemeh Ebrahimi ;
Fatemi, Afsaneh ;
Nematbakhsh, Mohammad Ali ;
Kia, Mahsa Abazari .
2024 14TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION SYSTEMS, ICPRS, 2024,