Enhanced Facial Emotion Recognition by Optimal Descriptor Selection with Neural Network

被引:14
作者
Ashok Kumar, P. M. [1 ]
Maddala, Jeevan Babu [2 ]
Martin Sagayam, K. [3 ]
机构
[1] KL Deemed Univ, Dept Comp Sci Engn, Vaddeswaram, Andhra Pradesh, India
[2] Vasireddy Venkatadri Inst Technol, Dept Comp Sci Engn, Guntur, Andhra Pradesh, India
[3] Karunya Inst Technol & Sci, Dept Elect & Commun Engn, Coimbatore, Tamil Nadu, India
关键词
Affine-scale-invariant feature transform; Convolutional neural network; Facial emotion recognition; Multi-verse optimization; Neural network; Scale-invariant feature transform; Whale optimization algorithm;
D O I
10.1080/03772063.2021.1902868
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Facial Emotion Recognition (FER) is the approach of detecting emotions of humans from facial expressions. Emotions are detected automatically by the human brain and hence, many computer aided techniques are implemented for recognizing emotions. Recognition of natural emotions is an exciting area with a broad range of real time applications like automated tutoring models, smart environments computer-human interaction, driver warning systems, and video and image retrieval. The major goal of this paper is to implement an intelligent model for FER. The proposed model involves few steps: (a) Face extraction (b) Image filtering, (c) Extraction of facial components, (d) Descriptor selection, and (d) Classification. Initially, the face is extracted from the input image by the Viola-Jones method, which is generally employed for the detection of object. Further, the noise of the image is filtered by the Gabor Filtering. Further, the facial components are extracted as features via the Affine-Scale-Invariant Feature Transform (ASIFT), which is the modified version of SIFT method. Since the length of the descriptors generated from ASIFT is high; the number of descriptors is reduced by the optimal descriptor selection approach with the aid of hybrid meta-heuristic algorithm termed as MV-WOA. The extracted descriptors are subjected to Neural Network (NN). As a modification to the existing machine learning algorithms, the number of hidden neurons in the NN is optimized by the proposed WOA+MVO algorithm. By conducting experiments, the results demonstrate that the developed system can perform better the recent traditional approaches for emotion recognition for classifying seven emotions like normal, smile, sad, surprise, anger, fear, and disgust.
引用
收藏
页码:2595 / 2614
页数:20
相关论文
共 31 条
[1]   Enhanced Human Face Recognition Using LBPH Descriptor, Multi-KNN, and Back-Propagation Neural Network [J].
Abuzneid, Mohannad A. ;
Mahmood, Ausif .
IEEE ACCESS, 2018, 6 :20641-20651
[2]  
Agassi Felix A., 2018, INT J ENG TECHNOL UA, V7, P9
[3]  
Azeem A., 2015, J. appl. res. technol, V13, P402
[4]   Orientation biases for facial emotion recognition during childhood and adulthood [J].
Balas, Benjamin ;
Huynh, Carol ;
Saville, Alyson ;
Schmidt, Jamie .
JOURNAL OF EXPERIMENTAL CHILD PSYCHOLOGY, 2015, 140 :171-183
[5]   Semantic-Emotion Neural Network for Emotion Recognition From Text [J].
Batbaatar, Erdenebileg ;
Li, Meijing ;
Ryu, Keun Ho .
IEEE ACCESS, 2019, 7 :111866-111878
[6]  
Bhattacharyya, 2016, INT J SOFT ENG ITS A, V10, P43
[7]  
Chetty M.S.R., 2018, J ADV RES DYN CONT S, V10, P1349
[8]  
Deshpande N.T., 2017, Advances in Computational Sciences and Technology, V10, P1173, DOI DOI 10.9790/0661-1806020106
[9]   Guest Editorial: The Computational Face [J].
Escalera, Sergio ;
Baro, Xavier ;
Guyon, Isabelle ;
Escalante, Hugo Jair ;
Tzimiropoulos, Georgios ;
Valstar, Michel ;
Pantic, Maja ;
Cohn, Jeffrey ;
Kanade, Takeo .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (11) :2541-2545
[10]   A novel facial emotion recognition scheme based on graph mining [J].
Hassan, Alia K. ;
Mohammed, Suhaila N. .
DEFENCE TECHNOLOGY, 2020, 16 (05) :1062-1072