Hyperparameter elegance: fine-tuning text analysis with enhanced genetic algorithm hyperparameter landscape

被引:0
作者
Tripathy, Gyananjaya [1 ]
Sharaff, Aakanksha [1 ]
机构
[1] Natl Inst Technol, Dept Comp Sci & Engn, Raipur 492010, Chhattisgarh, India
关键词
Hyperparameter tuning; LSTM; Attention mechanism; CNN; Text classification; OPTIMIZATION;
D O I
10.1007/s10115-024-02202-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to the significant participation of the users, it is highly challenging to handle enormous datasets using machine learning algorithms. Deep learning methods are therefore designed with efficient hyperparameter sets to enhance the processing of the vast corpus. Different hyperparameter tuning models have been used previously in various studies. Still, tuning the deep learning models with the greatest possible number of hyperparameters has not yet been possible. This study developed a modified optimization methodology for effective hyperparameter identification, addressing the shortcomings of the previous studies. To get the optimum outcome, an enhanced genetic algorithm is used with modified crossover and mutation. The method has the ability to tune several hyperparameters simultaneously. The benchmark datasets for online reviews show outstanding results from the proposed methodology. The outcome demonstrates that the presented enhanced genetic algorithm-based hyperparameter tuning model performs better than other standard approaches with 88.73% classification accuracy, 87.31% sensitivity, 90.15% specificity, and 88.58% F-score value for the IMDB dataset and 92.17% classification accuracy, 91.89% sensitivity, 92.47% specificity, and 92.50% F-score value for the Yelp dataset while requiring less processing effort. To further enhance the performance, attention mechanism is applied to the designed model, achieving 89.62% accuracy, 88.59% sensitivity, 91.89% specificity, and 89.35% F-score with the IMDB dataset and 93.29% accuracy, 92.04% sensitivity, 93.22% specificity, and 92.98% F-score with the Yelp dataset.
引用
收藏
页码:6761 / 6783
页数:23
相关论文
共 45 条
  • [1] The Arithmetic Optimization Algorithm
    Abualigah, Laith
    Diabat, Ali
    Mirjalili, Seyedali
    Elaziz, Mohamed Abd
    Gandomi, Amir H.
    [J]. COMPUTER METHODS IN APPLIED MECHANICS AND ENGINEERING, 2021, 376
  • [2] Ashok DM, 2020, 2020 INT C EM TECHN, P1, DOI [10.1109/INCET49848.2020.9154090, DOI 10.1109/INCET49848.2020.9154090]
  • [3] A CNN-LSTM Stock Prediction Model Based on Genetic Algorithm Optimization
    Baek, Heon
    [J]. ASIA-PACIFIC FINANCIAL MARKETS, 2024, 31 (02) : 205 - 220
  • [4] Utilizing dependence among variables in evolutionary algorithms for mixed-integer programming: A case study on multi-objective constrained portfolio optimization
    Chen, Yi
    Zhou, Aimin
    Das, Swagatam
    [J]. SWARM AND EVOLUTIONARY COMPUTATION, 2021, 66
  • [5] A New Automatic Hyperparameter Recommendation Approach Under Low-Rank Tensor Completion e Framework
    Deng, Liping
    Xiao, Mingqing
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (04) : 4038 - 4050
  • [6] Eberhart R., 1995, P 6 INT S MICR HUM S, P39, DOI DOI 10.1109/MHS.1995.494215
  • [7] Stratified hyperparameters optimization of feed-forward neural network for social network spam detection (SON2S)
    Elakkiya, E.
    Selvakumar, S.
    [J]. SOFT COMPUTING, 2022, 26 (21) : 11915 - 11934
  • [8] Classification of tweets data based on polarity using improved RBF kernel of SVM
    Gopi A.P.
    Jyothi R.N.S.
    Narayana V.L.
    Sandeep K.S.
    [J]. International Journal of Information Technology, 2023, 15 (2) : 965 - 980
  • [9] Sentiment recognition and analysis method of official document text based on BERT-SVM model
    Hao, Shule
    Zhang, Peng
    Liu, Sen
    Wang, Yuhang
    [J]. NEURAL COMPUTING & APPLICATIONS, 2023, 35 (35) : 24621 - 24632
  • [10] Natural Language Processing in Electronic Health Records in relation to healthcare decision-making: A systematic review
    Hossain, Elias
    Rana, Rajib
    Higgins, Niall
    Soar, Jeffrey
    Barua, Prabal Datta
    Pisani, Anthony R.
    Turner, Kathryn
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 155