Micro-Expression Recognition Algorithm Using Regions of Interest and the Weighted ArcFace Loss

被引:0
作者
Zhang, Peiying [1 ]
Wang, Ruixin [1 ]
Luo, Jia [2 ]
Shi, Lei [3 ,4 ,5 ]
机构
[1] China Univ Petr East China, Qingdao Inst Software, Coll Comp Sci & Technol, Qingdao 266580, Peoples R China
[2] Beijing Univ Technol, Coll Econ & Management, Beijing 100124, Peoples R China
[3] Commun Univ China, State Key Lab Media Convergence & Commun, Beijing 100024, Peoples R China
[4] Yangtze River Delta Res Inst NPU, State Key Lab Intelligent Game, Taicang 215400, Peoples R China
[5] Yunnan Normal Univ, Key Lab Educ Informatizat Nationalities, Minist Educ, Kunming 650092, Peoples R China
来源
ELECTRONICS | 2025年 / 14卷 / 01期
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
micro-expression recognition; convolutional neural networks; region of interest;
D O I
10.3390/electronics14010002
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Micro-expressions often reveal more genuine emotions but are challenging to recognize due to their brief duration and subtle amplitudes. To address these challenges, this paper introduces a micro-expression recognition method leveraging regions of interest (ROIs). Firstly, four specific ROIs are selected based on an analysis of the optical flow and relevant action units activated during micro-expressions. Secondly, effective feature extraction is achieved using the optical flow method. Thirdly, a block partition module is integrated into a convolutional neural network to reduce computational complexity, thereby enhancing model accuracy and generalization. The proposed model achieves notable performance, with accuracies of 93.96%, 86.15%, and 81.17% for three-class recognition on the CASME II, SAMM, and SMIC datasets, respectively. For five-class recognition, the model achieves accuracies of 81.63% on the CASME II dataset and 84.31% on the SMIC dataset. Experimental results validate the effectiveness of using ROIs in improving micro-expression recognition accuracy.
引用
收藏
页数:15
相关论文
共 43 条
[1]  
Bahmanabady Ehsan, 2023, 2023 31st International Conference on Electrical Engineering (ICEE), P463, DOI 10.1109/ICEE59167.2023.10334654
[2]   Facial Micro-Expression Recognition Using Two-Dimensional Landmark Feature Maps [J].
Choi, Dong Yoon ;
Song, Byung Cheol .
IEEE ACCESS, 2020, 8 :121549-121563
[3]   ArcFace: Additive Angular Margin Loss for Deep Face Recognition [J].
Deng, Jiankang ;
Guo, Jia ;
Xue, Niannan ;
Zafeiriou, Stefanos .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :4685-4694
[4]   AN ARGUMENT FOR BASIC EMOTIONS [J].
EKMAN, P .
COGNITION & EMOTION, 1992, 6 (3-4) :169-200
[5]  
Ekman P., 1978, FACIAL ACTION CODING
[6]   SelfME: Self-Supervised Motion Learning for Micro-Expression Recognition [J].
Fan, Xinqi ;
Chen, Xueli ;
Jiang, Mingjie ;
Shahid, Ali Raza ;
Yan, Hong .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, :13834-13843
[7]   Fuzzy Histogram of Optical Flow Orientations for Micro-Expression Recognition [J].
Happy, S. L. ;
Routray, Aurobinda .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2019, 10 (03) :394-406
[8]   Micro-Expression Recognition with Expression-State Constrained Spatio-Temporal Feature Representations [J].
Kim, Dae Hoe ;
Baddar, Wissam J. ;
Ro, Yong Man .
MM'16: PROCEEDINGS OF THE 2016 ACM MULTIMEDIA CONFERENCE, 2016, :382-386
[9]   Paul Ekman and the search for the isolated face in the 1960s [J].
Kim, Heewon .
JOURNAL OF THE HISTORY OF THE BEHAVIORAL SCIENCES, 2024, 60 (04)
[10]   Triple-ATFME: Triple-Branch Attention Fusion Network for Micro-Expression Recognition [J].
Li, Fei ;
Nie, Ping ;
You, Meiming ;
Chen, Zhichao ;
Wang, Guoqiang .
ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2025, 50 (02) :807-823