The first look: a biometric analysis of emotion recognition using key facial features

被引:0
作者
Gonzalez-Acosta, Ana M. S. [1 ]
Vargas-Trevino, Marciano [1 ]
Batres-Mendoza, Patricia [1 ]
Guerra-Hernandez, Erick I. [1 ]
Gutierrez-Gutierrez, Jaime [1 ]
Cano-Perez, Jose L. [1 ]
Solis-Arrazola, Manuel A. [1 ,2 ]
Rostro-Gonzalez, Horacio [2 ,3 ]
机构
[1] Benito Juarez Autonomous Univ Oaxaca, Fac Biol Syst & Technol Innovat, Lab Artificial Intelligence Robot & Control, Oaxaca, Mexico
[2] Univ Guanajuato, Dept Elect Engn, Div Ingn Campus Irapuato Salamanca, Salamanca, Mexico
[3] Univ Ramon Llull, Inst Quim Sarria, Grp Ingn Prod Ind, Res Grp,Sch Engn, Barcelona, Spain
来源
FRONTIERS IN COMPUTER SCIENCE | 2025年 / 7卷
关键词
emotion recognition; eye-tracking analysis; facial landmarks; biometric validation; machine learning and AI; EXPRESSIONS; MOUTH;
D O I
10.3389/fcomp.2025.1554320
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Introduction Facial expressions play a crucial role in human emotion recognition and social interaction. Prior research has highlighted the significance of the eyes and mouth in identifying emotions; however, limited studies have validated these claims using robust biometric evidence. This study investigates the prioritization of facial features during emotion recognition and introduces an optimized approach to landmark-based analysis, enhancing efficiency without compromising accuracy.Methods A total of 30 participants were recruited to evaluate images depicting six emotions: anger, disgust, fear, neutrality, sadness, and happiness. Eye-tracking technology was utilized to record gaze patterns, identifying the specific facial regions participants focused on during emotion recognition. The collected data informed the development of a streamlined facial landmark model, reducing the complexity of traditional approaches while preserving essential information.Results The findings confirmed a consistent prioritization of the eyes and mouth, with minimal attention allocated to other facial areas. Leveraging these insights, we designed a reduced landmark model that minimizes the conventional 68-point structure to just 24 critical points, maintaining recognition accuracy while significantly improving processing speed.Discussion The proposed model was evaluated using multiple classifiers, including Multi-Layer Perceptron (MLP), Random Decision Forest (RDF), and Support Vector Machine (SVM), demonstrating its robustness across various machine learning approaches. The optimized landmark selection reduces computational costs and enhances real-time emotion recognition applications. These results suggest that focusing on key facial features can improve the efficiency of biometric-based emotion recognition systems without sacrificing accuracy.
引用
收藏
页数:16
相关论文
共 40 条
[1]  
Alpaydn E., 2014, Introduction to Machine Learning, V2nd
[2]  
Bernhardt C., 2022, Facial Expressions and Emotions, VWiesbaden, P221, DOI [10.1007/978-3-658-36929-310, DOI 10.1007/978-3-658-36929-310]
[3]   Best practices in eye tracking research [J].
Carter, Benjamin T. ;
Luke, Steven G. .
INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2020, 155 :49-62
[4]   Expert gaze as a usability indicator of medical AI decision support systems: a preliminary study [J].
Castner, Nora ;
Arsiwala-Scheppach, Lubaina ;
Mertens, Sarah ;
Krois, Joachim ;
Thaqi, Enkeleda ;
Kasneci, Enkelejda ;
Wahl, Siegfried ;
Schwendicke, Falk .
NPJ DIGITAL MEDICINE, 2024, 7 (01)
[5]   MiEmo: A multi-modal platform on emotion recognition for children with autism spectrum condition [J].
Chitti, Eleonora ;
Actis-Grosso, Rossana ;
Ricciardelli, Paola ;
Olivari, Benedetta ;
Carenzi, Cecilia ;
Tedoldi, Mariantonia ;
Borghese, N. Alberto .
COMPUTERS IN HUMAN BEHAVIOR REPORTS, 2025, 17
[6]   Experiments on real-life emotions challenge Ekman's model [J].
Coppini, Sara ;
Lucifora, Chiara ;
Vicario, Carmelo M. ;
Gangemi, Aldo .
SCIENTIFIC REPORTS, 2023, 13 (01)
[7]   FERMOUTH: Facial Emotion Recognition from the MOUTH Region [J].
De Carolis, Berardina ;
Macchiarulo, Nicola ;
Palestra, Giuseppe ;
De Matteis, Alberto Pio ;
Lippolis, Andrea .
IMAGE ANALYSIS AND PROCESSING, ICIAP 2023, PT I, 2023, 14233 :147-158
[8]   FACES-A database of facial expressions in young, middle-aged, and older women and men: Development and validation [J].
Ebner, Natalie C. ;
Riediger, Michaela ;
Lindenberger, Ulman .
BEHAVIOR RESEARCH METHODS, 2010, 42 (01) :351-362
[9]  
Eppel A., 2018, Understanding and Recognizing Emotion, DOI DOI 10.1007/978-3-319-74995-23
[10]  
Escamilla-Hernandez E., 2015, Intelligent Software Methodologies, Tools and Techniques, V532, P529, DOI [10.1007/978-3-319-22689, DOI 10.1007/978-3-319-22689-741]