Accurate computing of facial expression recognition using a hybrid feature extraction technique

被引:14
作者
Kommineni, Jenni [1 ,2 ]
Mandala, Satria [3 ]
Sunar, Mohd Shahrizal [1 ,2 ]
Chakravarthy, Parvathaneni Midhu [4 ]
机构
[1] Univ Teknol Malaysia, Fac Engn & Media, Sch Comp, Johor Baharu, Malaysia
[2] Univ Teknol Malaysia, Game Innovat Ctr Excellence, Inst Human Ctr Engn, Johor Baharu, Malaysia
[3] Telkom Univ, Sch Comp, Human Centr HUMIC Engn, Bandung, Indonesia
[4] HSBC, Riyadh, Saudi Arabia
关键词
Facial expression; Emotion recognition; Human– computer interaction; Dual-tree M-band wavelet transform (DTMBWT); Gaussian mixture model (GMM); Gray-level co-occurrence matrix (GLCM); TREE; DEEP;
D O I
10.1007/s11227-020-03468-8
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Facial expression recognition (FER) serves as an essential tool for understanding human emotional behaviors. Facial expressions provide a wealth of information about intentions, emotions, and other inner states. Over the past two decades, the development of an automatic FER device has become one of the most demanding multimedia research areas in human-computer interaction systems. Several automatic systems have been introduced and have achieved precise identification accuracies. Due to the complex nature of the human face, however, problems still exist. Researchers are still struggling to develop effective methods for extracting features from images because of unclear features. This work proposes a methodology that improves high-performance computing in terms of the facial expression recognition accuracy. To achieve the goal of high accuracy, a hybrid method is proposed using the dual-tree m-band wavelet transform (DTMBWT) algorithm based on energy, entropy, and gray-level co-occurrence matrix (GLCM). It is accompanied by the use of a Gaussian mixture model (GMM) as the classification scheme to provide efficient identification of database images in terms of facial expressions. Using the DTMBWT, it is possible to derive many expression features from decomposition levels 1 to 6. Moreover, along with the GLCM features, the contrast and homogeneity features can be retrieved. All the features are eventually categorized and recognized with the aid of the GMM classifier. The proposed algorithms are tested using Japanese Female Facial Expression (JAFFE) database with seven different facial expressions: happiness, sadness, anger, fear, neutral, surprise, and disgust. The results of the experiments show that the highest precision of the proposed technique is 99.53%, which is observed at the 4(th) decomposition level of the DTMBWT.
引用
收藏
页码:5019 / 5044
页数:26
相关论文
共 50 条
[21]   RECOGNITION OF FACIAL EXPRESSION USING ACTION UNIT CLASSIFICATION TECHNIQUE [J].
Thuthi, D. .
2014 INTERNATIONAL CONFERENCE ON RECENT TRENDS IN INFORMATION TECHNOLOGY (ICRTIT), 2014,
[22]   Performance Analysis of Frequency Domain based Feature Extraction Techniques for Facial Expression Recognition [J].
Janu, Neha ;
Mathur, Pratistha ;
Gupta, Sandeep Kumar ;
Agrwal, Shubh Lakshmi .
PROCEEDINGS OF THE 7TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, DATA SCIENCE AND ENGINEERING (CONFLUENCE 2017), 2017, :591-594
[23]   A Hybrid Approach for Facial Expression Recognition [J].
Puthanidam, Roshni Velluva ;
Moh, Teng-Sheng .
PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON UBIQUITOUS INFORMATION MANAGEMENT AND COMMUNICATION (IMCOM 2018), 2018,
[24]   Facial expression recognition based on anomaly feature [J].
Kan Hong .
Optical Review, 2022, 29 :178-187
[25]   A novel fuzzy facial expression recognition system based on facial feature extraction from color face images [J].
Ilbeygi, Mahdi ;
Shah-Hosseini, Hamed .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2012, 25 (01) :130-146
[26]   Robust Feature Detection for Facial Expression Recognition [J].
Spiros Ioannou ;
George Caridakis ;
Kostas Karpouzis ;
Stefanos Kollias .
EURASIP Journal on Image and Video Processing, 2007
[27]   EMOTIONAL FACIAL EXPRESSION RECOGNITION FROM TWO DIFFERENT FEATURE DOMAINS [J].
Kim, Jonghwa ;
Jung, Frank .
ICAART 2010: PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE, VOL 1: ARTIFICIAL INTELLIGENCE, 2010, :631-634
[28]   Feature acquisition and analysis for facial expression recognition using convolutional neural networks [J].
Nishime T. ;
Endo S. ;
Toma N. ;
Yamada K. ;
Akamine Y. .
Transactions of the Japanese Society for Artificial Intelligence, 2017, 32 (05) :F-H34_1
[29]   Robust Facial Expression Recognition using Gabor Feature and Bayesian Discriminating Classifier [J].
Piparsaniyan, Yamini ;
Sharma, Vijay K. ;
Mahapatra, K. K. .
2014 INTERNATIONAL CONFERENCE ON COMMUNICATIONS AND SIGNAL PROCESSING (ICCSP), 2014,
[30]   An efficient automatic facial expression recognition using local neighborhood feature fusion [J].
P. Shanthi ;
S. Nickolas .
Multimedia Tools and Applications, 2021, 80 :10187-10212