Accurate computing of facial expression recognition using a hybrid feature extraction technique

被引:14
作者
Kommineni, Jenni [1 ,2 ]
Mandala, Satria [3 ]
Sunar, Mohd Shahrizal [1 ,2 ]
Chakravarthy, Parvathaneni Midhu [4 ]
机构
[1] Univ Teknol Malaysia, Fac Engn & Media, Sch Comp, Johor Baharu, Malaysia
[2] Univ Teknol Malaysia, Game Innovat Ctr Excellence, Inst Human Ctr Engn, Johor Baharu, Malaysia
[3] Telkom Univ, Sch Comp, Human Centr HUMIC Engn, Bandung, Indonesia
[4] HSBC, Riyadh, Saudi Arabia
关键词
Facial expression; Emotion recognition; Human– computer interaction; Dual-tree M-band wavelet transform (DTMBWT); Gaussian mixture model (GMM); Gray-level co-occurrence matrix (GLCM); TREE; DEEP;
D O I
10.1007/s11227-020-03468-8
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Facial expression recognition (FER) serves as an essential tool for understanding human emotional behaviors. Facial expressions provide a wealth of information about intentions, emotions, and other inner states. Over the past two decades, the development of an automatic FER device has become one of the most demanding multimedia research areas in human-computer interaction systems. Several automatic systems have been introduced and have achieved precise identification accuracies. Due to the complex nature of the human face, however, problems still exist. Researchers are still struggling to develop effective methods for extracting features from images because of unclear features. This work proposes a methodology that improves high-performance computing in terms of the facial expression recognition accuracy. To achieve the goal of high accuracy, a hybrid method is proposed using the dual-tree m-band wavelet transform (DTMBWT) algorithm based on energy, entropy, and gray-level co-occurrence matrix (GLCM). It is accompanied by the use of a Gaussian mixture model (GMM) as the classification scheme to provide efficient identification of database images in terms of facial expressions. Using the DTMBWT, it is possible to derive many expression features from decomposition levels 1 to 6. Moreover, along with the GLCM features, the contrast and homogeneity features can be retrieved. All the features are eventually categorized and recognized with the aid of the GMM classifier. The proposed algorithms are tested using Japanese Female Facial Expression (JAFFE) database with seven different facial expressions: happiness, sadness, anger, fear, neutral, surprise, and disgust. The results of the experiments show that the highest precision of the proposed technique is 99.53%, which is observed at the 4(th) decomposition level of the DTMBWT.
引用
收藏
页码:5019 / 5044
页数:26
相关论文
共 50 条
[31]   Editorial: Facial Expression Recognition and Computing: An Interdisciplinary Perspective [J].
Zhao, Ke ;
Chen, Tong ;
Chen, Liming ;
Fu, Xiaolan ;
Meng, Hongying ;
Yap, Moi Hoon ;
Yuan, Jiajin ;
Davison, Adrian K. .
FRONTIERS IN PSYCHOLOGY, 2022, 13
[32]   A Facial Expression Recognition Method Based on Feature Blocks [J].
Wang, Wencheng ;
Chang, Faliang .
CONTROL ENGINEERING AND APPLIED INFORMATICS, 2016, 18 (04) :77-85
[33]   Facial feature based expression recognition for an affective interface [J].
Ren, FJ ;
Nagano, N ;
Bracewell, DB ;
Kuroiwa, S ;
Tanioka, T ;
Zhang, Z ;
Zong, CQ .
PROCEEDINGS OF THE NINTH IASTED INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, 2005, :423-428
[34]   Fusion of feature sets and classifiers for facial expression recognition [J].
Zavaschi, Thiago H. H. ;
Britto, Alceu S., Jr. ;
Oliveira, Luiz E. S. ;
Koerich, Alessandro L. .
EXPERT SYSTEMS WITH APPLICATIONS, 2013, 40 (02) :646-655
[35]   Multiple Classifier Learning of New Facial Extraction Approach for Facial Expression Recognition using Depth Sensor [J].
Chanthaphan, Nattawat ;
Uchimura, Keiichi ;
Satonaka, Takami ;
Makioka, Tsuyoshi .
SIGMAP: PROCEEDINGS OF THE 13TH INTERNATIONAL JOINT CONFERENCE ON E-BUSINESS AND TELECOMMUNICATIONS - VOL. 5, 2016, :19-27
[36]   Human Facial Expression Recognition System Using Artificial Neural Network Classification of Gabor Feature Based Facial Expression Information [J].
Islam, Bayezid ;
Mahmud, Firoz ;
Hossain, Arafat ;
Mia, Md. Sumon ;
Goala, Pushpen Bikash .
2018 4TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND INFORMATION & COMMUNICATION TECHNOLOGY (ICEEICT), 2018, :364-368
[37]   FACIAL EXPRESSION RECOGNITION USING HYBRID FEATURES AND SELF-ORGANIZING MAPS [J].
Farooq, Faisal ;
Ahmed, Jalal ;
Zheng, Lihong .
2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, :409-414
[38]   Facial Micro-Expression Recognition in Video using Squeezed Landmark Feature Maps [J].
Kim, Nayeon ;
Cho, Sukhee ;
Ahn, Chung Hyun ;
Bae, Byungjun .
12TH INTERNATIONAL CONFERENCE ON ICT CONVERGENCE (ICTC 2021): BEYOND THE PANDEMIC ERA WITH ICT CONVERGENCE INNOVATION, 2021, :1107-1110
[39]   Facial Expression Recognition Using Facial Movement Features [J].
Zhang, Ligang ;
Tjondronegoro, Dian .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2011, 2 (04) :219-229
[40]   Invariant Feature Extraction for Facial Recognition: A Survey of the State-of-the-art [J].
Hassan, Adam ;
Viriri, Serestina .
2018 CONFERENCE ON INFORMATION COMMUNICATIONS TECHNOLOGY AND SOCIETY (ICTAS), 2018,