Transfer Learning for Facial Expression Recognition

被引:3
作者
Kumar, Rajesh [1 ]
Corvisieri, Giacomo [2 ]
Fici, Tullio Flavio [2 ]
Hussain, Syed Ibrar [1 ]
Tegolo, Domenico [1 ]
Valenti, Cesare [1 ]
机构
[1] Univ Palermo, Dipartimento Matemat & Informat, Via Archirafi 34, I-90123 Palermo, Italy
[2] Italtel SpA, Viale Schiavonetti 270-F, I-00173 Rome, Italy
关键词
face detection; facial expression recognition; deep learning techniques;
D O I
10.3390/info16040320
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Facial expressions reflect psychological states and are crucial for understanding human emotions. Traditional facial expression recognition methods face challenges in real-world healthcare applications due to variations in facial structure, lighting conditions and occlusion. We present a methodology based on transfer learning with the pre-trained models VGG-19 and ResNet-152, and we highlight dataset-specific preprocessing techniques that include resizing images to 124 x 124 pixels, augmenting the data and selectively freezing layers to enhance the robustness of the model. This study explores the application of deep learning-based facial expression recognition in healthcare, particularly for remote patient monitoring and telemedicine, where accurate facial expression recognition can enhance patient assessment and early diagnosis of psychological conditions such as depression and anxiety. The proposed method achieved an average accuracy of 0.98 on the CK+ dataset, demonstrating its effectiveness in controlled environments. However performance varied across datasets, with accuracy rates of 0.44 on FER2013 and 0.89 on JAFFE, reflecting the challenges posed by noisy and diverse data. Our findings emphasize the potential of deep learning-based facial expression recognition in healthcare applications while underscoring the importance of dataset-specific model optimization to improve generalization across different data distributions. This research contributes to the advancement of automated facial expression recognition in telemedicine, supporting enhanced doctor-patient communication and improving patient care.
引用
收藏
页数:22
相关论文
共 78 条
[1]  
Abadi M., 2021, TensorFlow: A System for Large-Scale Machine Learning
[2]  
Abdullah S.M.S, 2021, J. Soft Comput. Data Min, V2, P53, DOI DOI 10.30880/JSCDM.2021.02.01.006
[3]   Performance Evaluation of Deep CNN-Based Crack Detection and Localization Techniques for Concrete Structures [J].
Ali, Luqman ;
Alnajjar, Fady ;
Al Jassmi, Hamad ;
Gocho, Munkhjargal ;
Khan, Wasif ;
Serhani, M. Adel .
SENSORS, 2021, 21 (05) :1-22
[4]  
Ali M., 2020, Int. J. Sci. Eng. Res, V11, P1318
[5]  
Anaconda I., 2021, Anaconda: The Open Data Science Platform
[6]  
[Anonymous], 2016, Regulation (EU). 2016/679 of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation)
[7]   Enhanced Facial Emotion Recognition by Optimal Descriptor Selection with Neural Network [J].
Ashok Kumar, P. M. ;
Maddala, Jeevan Babu ;
Martin Sagayam, K. .
IETE JOURNAL OF RESEARCH, 2023, 69 (05) :2595-2614
[8]  
Bagherian E., 2008, P INT S INF TECHN KU, VVolume 2, P1
[9]   A novel enhanced convolution neural network with extreme learning machine: facial emotional recognition in psychology practices [J].
Banskota, Nitesh ;
Alsadoon, Abeer ;
Prasad, P. W. C. ;
Dawoud, Ahmed ;
Rashid, Tarik A. ;
Alsadoon, Omar Hisham .
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (05) :6479-6503
[10]   Video-Based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms [J].
Ben, Xianye ;
Ren, Yi ;
Zhang, Junping ;
Wang, Su-Jing ;
Kpalma, Kidiyo ;
Meng, Weixiao ;
Liu, Yong-Jin .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) :5826-5846