An Automatic Facial Expression Recognition System Employing Convolutional Neural Network with Multi-strategy Gravitational Search Algorithm

被引:6
作者
Alenazy, Wael Mohammad [1 ]
Alqahtani, Abdullah Saleh [1 ]
机构
[1] CFY Deanship King Saud Univ, Dept Self Dev Skills, Riyadh, Saudi Arabia
关键词
Facial Expression; Convolutional Neural Network; Multi-strategy Gravitational Search Algorithm; SVM Classifier; and Hyperparameter Tuning; FUSION;
D O I
10.1080/02564602.2020.1825125
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Facial expression recognition (FER) plays a vital role in image processing according to the widespread development of human interactive applications. In the past few years, various researchers have focused on FER for implementing it in different applications. The existing system suffers from various complexities such as low accuracy, computational cost, and poor recognition performances. In this article, we proposed a novel concept to recognize facial expressions. The proposed work comprises three sections that are pre-processing, feature extraction, and classification. The pre-processing techniques remove the unwanted data from the original image and enhance the crucial details for further processing. The Convolutional Neural Network (CNN) is used for feature extraction. But, it yields lower performance in terms of feature extraction due to the shortage of hyperparameter tuning. Hence, the Multi-strategy Gravitational Search Algorithm (M-GSA) is utilized to extract the facial expression features from the eyebrow movement, nose, chin, and lip corner of the facial images. The facial expressions are classified via the Support Vector Machine (SVM) classifier. In this work, the top five facial expressions such as surprise, sad, happy, fear, and angry with three facial expression datasets such as FER-2013 dataset, CK+ dataset, and JAFFE dataset. Ultimately, the proposed method demonstrates better classification accuracy and recognition rates than different kinds of state-of-art methods.
引用
收藏
页码:72 / 85
页数:14
相关论文
共 40 条
[1]   SSR2: Sparse signal recovery for single-image super-resolution on faces with extreme low resolutions [J].
Abiantun, Ramzi ;
Juefei-Xu, Felix ;
Prabhu, Utsav ;
Savvides, Marios .
PATTERN RECOGNITION, 2019, 90 :308-324
[2]   Gravitational search algorithm based optimized deep learning model with diverse set of features for facial expression recognition [J].
Alenazy, Wael Mohammad ;
Alqahtani, Abdullah Saleh .
JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 12 (02) :1631-1646
[3]  
Alsmadi M. K., 2019, INVENTOR IMAM ABDULR, V10
[4]  
[Anonymous], 2012, 2012 IEEE COMPUTER S
[5]  
[Anonymous], 2004, CVPR WORKSHOP FACE P
[6]   Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection [J].
Belhumeur, PN ;
Hespanha, JP ;
Kriegman, DJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (07) :711-720
[7]   A principal component analysis of facial expressions [J].
Calder, AJ ;
Burton, AM ;
Miller, P ;
Young, AW ;
Akamatsu, S .
VISION RESEARCH, 2001, 41 (09) :1179-1208
[8]   Fast and Light Manifold CNN based 3D Facial Expression Recognition across Pose Variations [J].
Chen, Zhixing ;
Huang, Di ;
Wang, Yunhong ;
Chen, Liming .
PROCEEDINGS OF THE 2018 ACM MULTIMEDIA CONFERENCE (MM'18), 2018, :229-238
[9]  
Chew SW, 2012, PROC CVPR IEEE, P2554, DOI 10.1109/CVPR.2012.6247973
[10]  
Dan O., 2020, J ADOLESC, V82, DOI 10.1016/j.adolesce-nce.2020.04.010