Deep neural network-based emotion recognition using facial landmark features and particle swarm optimization

被引:2
作者
Vaijayanthi, S. [1 ]
Arunnehru, J. [1 ]
机构
[1] SRM Inst Sci & Technol, Dept Comp Sci & Engn, Vadapalani Campus, Chennai 600026, Tamil Nadu, India
关键词
Deep neural network; particle swarm optimization; facial motion recognition; geometrical features; EXPRESSION RECOGNITION;
D O I
10.1080/00051144.2024.2343964
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Relating specifically to human-computer interaction (HCI), computer vision research has placed a substantial emphasis on intelligent emotion recognition in recent years. The primary emphasis lies in investigating speech aspects and bodily motions, while the knowledge of recognizing emotions from facial expressions remains relatively unexplored. Automated facial emotion detection allows a machine to assess and understand a person's emotional state, allowing the system to predict intent by analyzing facial expressions. Therefore, this research provides a novel parameter selection strategy using swarm intelligence and a fitness function for intelligent recognition of micro emotions. This paper presents a novel method based on geometric visual representation obtained from facial landmark points. We employ the Deep Neural Networks (DNN) model to analyze the input features from the normalized angle and distance values derived from these landmarks. The results of the experiments show that Particle Swarm Optimization (PSO) worked very well by using only a few carefully chosen features. The method achieved a recognition success rate of 98.76% on the MUG dataset and 97.79% on the GEMEP datasets.
引用
收藏
页码:1088 / 1099
页数:12
相关论文
共 28 条
[1]  
Aifanti N., 2016, 11 INT WORK IMAGE AN, V10
[2]   Linear subspaces for facial expression recognition [J].
Aifanti, Niki ;
Delopoulos, Anastasios .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2014, 29 (01) :177-188
[3]  
Arunnehru J., 2020, Advances in Computational Intelligence, Security and Internet of Things: Second International Conference, ICCISIoT 2019. Communications in Computer and Information Science (1192), P16, DOI 10.1007/978-981-15-3666-3_2
[4]  
Arunnehru J., 2013, Motion intensity code for action recognition in video using PCA and SVM, DOI [10.1007/978-3-319-03844-5_8, DOI 10.1007/978-3-319-03844-5_8]
[5]   Parallel Scale Invariant Feature Transform Based Approach for Facial Expression Recognition [J].
Chickerur, Satyadhyan ;
Reddy, Tejaswini ;
Shabalina, Olga .
CREATIVITY IN INTELLIGENT TECHNOLOGIES AND DATA SCIENCE, CIT&DS 2015, 2015, 535 :621-636
[6]   Deep learning-based facial emotion recognition for human-computer interaction applications [J].
Chowdary, M. Kalpana ;
Nguyen, Tu N. ;
Hemanth, D. Jude .
NEURAL COMPUTING & APPLICATIONS, 2023, 35 (32) :23311-23328
[7]   The Facial Action Coding System for Characterization of Human Affective Response to Consumer Product-Based Stimuli: A Systematic Review [J].
Clark, Elizabeth A. ;
Kessinger, J'Nai ;
Duncan, Susan E. ;
Bell, Martha Ann ;
Lahne, Jacob ;
Gallagher, Daniel L. ;
O'Keefe, Sean F. .
FRONTIERS IN PSYCHOLOGY, 2020, 11
[8]   Emotion Expression in Body Action and Posture [J].
Dael, Nele ;
Mortillaro, Marcell ;
Scherer, Klaus R. .
EMOTION, 2012, 12 (05) :1085-1101
[9]   Deep Feature Selection for Facial Emotion Recognition Based on BPSO and SVM [J].
Donuk, Kenan ;
Ari, Ali ;
Ozdemir, Mehmet Fatih ;
Hanbay, Davut .
JOURNAL OF POLYTECHNIC-POLITEKNIK DERGISI, 2023, 26 (01) :131-142
[10]   A spatial-temporal framework based on histogram of gradients and optical flow for facial expression recognition in video sequences [J].
Fan, Xijian ;
Tjahjadi, Tardi .
PATTERN RECOGNITION, 2015, 48 (11) :3407-3416