Transfer Learning for Facial Expression Recognition

被引:3
作者
Kumar, Rajesh [1 ]
Corvisieri, Giacomo [2 ]
Fici, Tullio Flavio [2 ]
Hussain, Syed Ibrar [1 ]
Tegolo, Domenico [1 ]
Valenti, Cesare [1 ]
机构
[1] Univ Palermo, Dipartimento Matemat & Informat, Via Archirafi 34, I-90123 Palermo, Italy
[2] Italtel SpA, Viale Schiavonetti 270-F, I-00173 Rome, Italy
关键词
face detection; facial expression recognition; deep learning techniques;
D O I
10.3390/info16040320
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Facial expressions reflect psychological states and are crucial for understanding human emotions. Traditional facial expression recognition methods face challenges in real-world healthcare applications due to variations in facial structure, lighting conditions and occlusion. We present a methodology based on transfer learning with the pre-trained models VGG-19 and ResNet-152, and we highlight dataset-specific preprocessing techniques that include resizing images to 124 x 124 pixels, augmenting the data and selectively freezing layers to enhance the robustness of the model. This study explores the application of deep learning-based facial expression recognition in healthcare, particularly for remote patient monitoring and telemedicine, where accurate facial expression recognition can enhance patient assessment and early diagnosis of psychological conditions such as depression and anxiety. The proposed method achieved an average accuracy of 0.98 on the CK+ dataset, demonstrating its effectiveness in controlled environments. However performance varied across datasets, with accuracy rates of 0.44 on FER2013 and 0.89 on JAFFE, reflecting the challenges posed by noisy and diverse data. Our findings emphasize the potential of deep learning-based facial expression recognition in healthcare applications while underscoring the importance of dataset-specific model optimization to improve generalization across different data distributions. This research contributes to the advancement of automated facial expression recognition in telemedicine, supporting enhanced doctor-patient communication and improving patient care.
引用
收藏
页数:22
相关论文
共 78 条
[31]  
Kanna R.K., 2023, Int. J. Sci. Technol. Res, V9, P610
[32]  
Karilingappa K., 2023, IAES Int. J. Artif. Intell, V12, P79, DOI [10.11591/ijai.v12.i1.pp79-86, DOI 10.11591/IJAI.V12.I1.PP79-86]
[33]   Understanding Deep Learning Techniques for Recognition of Human Emotions Using Facial Expressions: A Comprehensive Survey [J].
Karnati, Mohan ;
Seal, Ayan ;
Bhattacharjee, Debotosh ;
Yazidi, Anis ;
Krejcar, Ondrej .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
[34]  
Kingma D. P., 2014, P ICLR
[35]  
Kumar R., 2024, J. Innov. Technol, V6, P41
[36]  
Kusuma GedePutra., Advances in Science, Technology and Engineering Systems, V5, P315, DOI DOI 10.25046/AJ050638
[37]   Audio-Visual Emotion Recognition With Preference Learning Based on Intended and Multi-Modal Perceived Labels [J].
Lei, Yuanyuan ;
Cao, Houwei .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (04) :2954-2969
[38]   Deep Facial Expression Recognition: A Survey [J].
Li, Shan ;
Deng, Weihong .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2022, 13 (03) :1195-1215
[39]   Facial expression recognition network with slow convolution and zero-parameter attention mechanism [J].
Li, Xi ;
Xiao, Zhenhua ;
Li, Chao ;
Li, Congcong ;
Liu, Hai ;
Fan, Guowen .
OPTIK, 2023, 283
[40]   Convolutional neural network model by deep learning and teaching robot in keyboard musical instrument teaching [J].
Liu, Jidong ;
Fu, Fang .
PLOS ONE, 2023, 18 (10)