Leveraging Symmetry and Addressing Asymmetry Challenges for Improved Convolutional Neural Network-Based Facial Emotion Recognition

被引:1
作者
Salagean, Gabriela Laura [1 ]
Leba, Monica [2 ]
Ionica, Andreea Cristina [3 ]
机构
[1] Univ Petrosani, Doctoral Sch, Petrosani 332006, Romania
[2] Univ Petrosani, Syst Control & Comp Engn Dept, Petrosani 332006, Romania
[3] Univ Petrosani, Management & Ind Engn Dept, Petrosani 332006, Romania
来源
SYMMETRY-BASEL | 2025年 / 17卷 / 03期
关键词
convolutional neural networks; deep learning; image preprocessing; real-time emotion analysis; EXPRESSION; CLASSIFICATION;
D O I
10.3390/sym17030397
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
This study introduces a custom-designed CNN architecture that extracts robust, multi-level facial features and incorporates preprocessing techniques to correct or reduce asymmetry before classification. The innovative characteristics of this research lie in its integrated approach to overcoming facial asymmetry challenges and enhancing CNN-based emotion recognition. This is completed by well-known data augmentation strategies-using methods such as vertical flipping and shuffling-that generate symmetric variations in facial images, effectively balancing the dataset and improving recognition accuracy. Additionally, a Loss Weight parameter is used to fine-tune training, thereby optimizing performance across diverse and unbalanced emotion classes. Collectively, all these contribute to an efficient, real-time facial emotion recognition system that outperforms traditional CNN models and offers practical benefits for various applications while also addressing the inherent challenges of facial asymmetry in emotion detection. Our experimental results demonstrate superior performance compared to other CNN methods, marking a step forward in applications ranging from human-computer interaction to immersive technologies while also acknowledging privacy and ethical considerations.
引用
收藏
页数:26
相关论文
共 59 条
[1]   Facial Expression Recognition using Transfer Learning and Fine-tuning Strategies: A Comparative Study [J].
Abdulsattar, Nadia Shamsulddin ;
Hussain, Mohammed Nasser .
PROCEEDING OF THE 2ND 2022 INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND SOFTWARE ENGINEERING (CSASE 2022), 2022, :101-106
[2]  
Agostinelli F., 2013, Adv. Neural Inf. Process. Syst, V26, P327
[3]  
[Anonymous], 2018, Advances in Hybridization of Intelligent Methods: Models, Systems and Applications
[4]   An Optical Flow Based Approach for Facial Expression Recognition [J].
Anthwal, Shivangi ;
Ganotra, Dinesh .
2019 INTERNATIONAL CONFERENCE ON POWER ELECTRONICS, CONTROL AND AUTOMATION (ICPECA-2019), 2019, :387-391
[5]  
Bapat M.M., 2024, Int. J. Comput, V23, P606, DOI [10.47839/ijc.23.4.3760, DOI 10.47839/IJC.23.4.3760]
[6]   Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection [J].
Belhumeur, PN ;
Hespanha, JP ;
Kriegman, DJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (07) :711-720
[7]   Multimodal Emotion Recognition via Convolutional Neural Networks: Comparison of different strategies on two multimodal datasets [J].
Bilotti, U. ;
Bisogni, C. ;
De Marsico, M. ;
Tramonte, S. .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 130
[8]  
Christou N., 2019, P 2019 SPRING INT C, P539, DOI [10.1007/978-981-13-1165-949, DOI 10.1007/978-981-13-1165-949]
[9]  
Darwin C., 1872, P374
[10]   FACIAL EXPRESSIONS OF EMOTION [J].
EKMAN, P ;
OSTER, H .
ANNUAL REVIEW OF PSYCHOLOGY, 1979, 30 :527-554