An Approach to Hyperparameter Tuning in Transfer Learning for Driver Drowsiness Detection Based on Bayesian Optimization and Random Search

被引:1
|
作者
Vo, Hoang-Tu [1 ]
Ngoc, Hoang Tran [1 ]
Quach, Luyl-Da [1 ]
机构
[1] FPT Univ, Software Engn Dept, Cantho City, Vietnam
关键词
Hyperparameter tuning; driver drowsiness detection; transfer learning; Bayesian optimization; Random search;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Driver drowsiness is a critical factor in road safety, and developing accurate models for detecting it is essential. Transfer learning has been shown to be an effective technique for driver drowsiness detection, as it enables models to leverage large, pre-existing datasets. However, the optimization of hyperparameters in transfer learning models can be challenging, as it involves a large search space. The core purpose of this research is on presenting an approach to hyperparameter tuning in transfer learning for driving fatigue detection based on Bayesian optimization and Random search algorithms. We examine the efficiency of our approach on a publicly available dataset using transfer learning models with the MobileNetV2, Xception, and VGG19 architectures. We explore the impact of hyperparameters such as dropout rate, activation function, the number of units (the number of dense nodes), optimizer, and learning rate on the transfer learning models' overall performance. Our experiments show that our approach improves the performance of the transfer learning models, obtaining cutting-edge results on the dataset for all three architectures. We also compare the efficiency of Bayesian optimization and Random search algorithms in terms of their ability to find optimal hyperparameters and indicate that Bayesian optimization is more efficient in finding optimal hyperparameters than Random search. The results of our study provide insights into the importance of hyperparameter tuning for transfer learning-based driver drowsiness detection using different transfer learning models and can guide the selection of hyperparameters and models for future studies in this field. Our proposed approach can be applied to other transfer learning tasks, making it a valuable contribution to the field of ML.
引用
收藏
页码:828 / 837
页数:10
相关论文
共 50 条
  • [1] Transfer Learning based Search Space Design for Hyperparameter Tuning
    Li, Yang
    Shen, Yu
    Jiang, Huaijun
    Bai, Tianyi
    Zhang, Wentao
    Zhang, Ce
    Cui, Bin
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 967 - 977
  • [2] Bayesian Optimization is Superior to Random Search for Machine Learning Hyperparameter Tuning: Analysis of the Black-Box Optimization Challenge 2020
    Turner, Ryan
    Eriksson, David
    McCourt, Michael
    Kiili, Juha
    Laaksonen, Eero
    Xu, Zhen
    Guyon, Isabelle
    NEURIPS 2020 COMPETITION AND DEMONSTRATION TRACK, VOL 133, 2020, 133 : 3 - 26
  • [3] Agent-Based Collaborative Random Search for Hyperparameter Tuning and Global Function Optimization
    Esmaeili, Ahmad
    Ghorrati, Zahra
    Matson, Eric T. T.
    SYSTEMS, 2023, 11 (05):
  • [4] Leveraging Transfer Learning for Driver Drowsiness Detection
    Dwivedi, Subhash Arun
    Attry, Amit
    Singla, Kanika
    ADVANCES IN DATA AND INFORMATION SCIENCES, 2022, 318 : 603 - 611
  • [5] Driver Drowsiness Detection by Multi-task and Transfer Learning
    Chang, Yuan
    Kameyama, Wataru
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY (IWAIT) 2022, 2022, 12177
  • [6] Efficient Deep Learning Hyperparameter Tuning using Cloud Infrastructure Intelligent Distributed Hyperparameter tuning with Bayesian Optimization in the Cloud
    Ranjit, Mercy Prasanna
    Ganapathy, Gopinath
    Sridhar, Kalaivani
    Arumugham, Vikram
    2019 IEEE 12TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING (IEEE CLOUD 2019), 2019, : 520 - 522
  • [7] Detection of driver drowsiness using transfer learning techniques
    Prajwal Mate
    Ninad Apte
    Manish Parate
    Sanjeev Sharma
    Multimedia Tools and Applications, 2024, 83 : 35553 - 35582
  • [8] Detection of driver drowsiness using transfer learning techniques
    Mate, Prajwal
    Apte, Ninad
    Parate, Manish
    Sharma, Sanjeev
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (12) : 35553 - 35582
  • [9] Privacy-Preserving Federated Transfer Learning for Driver Drowsiness Detection
    Zhang, Linlin
    Saito, Hideo
    Yang, Liang
    Wu, Jiajie
    IEEE ACCESS, 2022, 10 : 80565 - 80574
  • [10] Novel Transfer Learning Approach for Driver Drowsiness Detection Using Eye Movement Behavior
    Madni, Hamza Ahmad
    Raza, Ali
    Sehar, Rukhshanda
    Thalji, Nisrean
    Abualigah, Laith
    IEEE ACCESS, 2024, 12 : 64765 - 64778