Accurate computing of facial expression recognition using a hybrid feature extraction technique

被引:12
作者
Kommineni, Jenni [1 ,2 ]
Mandala, Satria [3 ]
Sunar, Mohd Shahrizal [1 ,2 ]
Chakravarthy, Parvathaneni Midhu [4 ]
机构
[1] Univ Teknol Malaysia, Fac Engn & Media, Sch Comp, Johor Baharu, Malaysia
[2] Univ Teknol Malaysia, Game Innovat Ctr Excellence, Inst Human Ctr Engn, Johor Baharu, Malaysia
[3] Telkom Univ, Sch Comp, Human Centr HUMIC Engn, Bandung, Indonesia
[4] HSBC, Riyadh, Saudi Arabia
关键词
Facial expression; Emotion recognition; Human– computer interaction; Dual-tree M-band wavelet transform (DTMBWT); Gaussian mixture model (GMM); Gray-level co-occurrence matrix (GLCM); TREE; DEEP;
D O I
10.1007/s11227-020-03468-8
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Facial expression recognition (FER) serves as an essential tool for understanding human emotional behaviors. Facial expressions provide a wealth of information about intentions, emotions, and other inner states. Over the past two decades, the development of an automatic FER device has become one of the most demanding multimedia research areas in human-computer interaction systems. Several automatic systems have been introduced and have achieved precise identification accuracies. Due to the complex nature of the human face, however, problems still exist. Researchers are still struggling to develop effective methods for extracting features from images because of unclear features. This work proposes a methodology that improves high-performance computing in terms of the facial expression recognition accuracy. To achieve the goal of high accuracy, a hybrid method is proposed using the dual-tree m-band wavelet transform (DTMBWT) algorithm based on energy, entropy, and gray-level co-occurrence matrix (GLCM). It is accompanied by the use of a Gaussian mixture model (GMM) as the classification scheme to provide efficient identification of database images in terms of facial expressions. Using the DTMBWT, it is possible to derive many expression features from decomposition levels 1 to 6. Moreover, along with the GLCM features, the contrast and homogeneity features can be retrieved. All the features are eventually categorized and recognized with the aid of the GMM classifier. The proposed algorithms are tested using Japanese Female Facial Expression (JAFFE) database with seven different facial expressions: happiness, sadness, anger, fear, neutral, surprise, and disgust. The results of the experiments show that the highest precision of the proposed technique is 99.53%, which is observed at the 4(th) decomposition level of the DTMBWT.
引用
收藏
页码:5019 / 5044
页数:26
相关论文
共 50 条
  • [11] Human vision inspired feature extraction for facial expression recognition
    Sadeghi, Hamid
    Raie, Abolghasem-A.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (21) : 30335 - 30353
  • [12] Facial expression recognition using feature level fusion
    Jain, Vanita
    Lamba, Puneet Singh
    Singh, Bhanu
    Namboothiri, Narayanan
    Dhall, Shafali
    JOURNAL OF DISCRETE MATHEMATICAL SCIENCES & CRYPTOGRAPHY, 2019, 22 (02) : 337 - 350
  • [13] Facial expression recognition based on anomaly feature
    Hong, Kan
    OPTICAL REVIEW, 2022, 29 (03) : 178 - 187
  • [14] An efficient automatic facial expression recognition using local neighborhood feature fusion
    Shanthi, P.
    Nickolas, S.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (07) : 10187 - 10212
  • [15] Feature Extraction based on Canonical Correlation Analysis using FMEDA and DPA for Facial Expression Recognition with RNN
    Ullah, Asad
    Wang, Jing
    Anwar, M. Shahid
    Ahmad, Usman
    Saeed, Uzair
    Wang, Jin
    PROCEEDINGS OF 2018 14TH IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP), 2018, : 418 - 423
  • [16] EMOTION RECOGNITION BY A NOVEL TRIANGULAR FACIAL FEATURE EXTRACTION METHOD
    Huang, Kuan-Chieh
    Kuo, Yau-Hwang
    Horng, Mong-Fong
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2012, 8 (11): : 7729 - 7746
  • [17] A robust feature extraction with optimized DBN-SMO for facial expression recognition
    Vedantham, Ramachandran
    Reddy, Edara Sreenivasa
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (29-30) : 21487 - 21512
  • [18] AUTOMATIC FACIAL FEATURE DETECTION FOR FACIAL EXPRESSION RECOGNITION
    Danisman, Taner
    Bilasco, Marius
    Lhaddadene, Nacim
    Djeraba, Chabane
    VISAPP 2010: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON COMPUTER VISION THEORY AND APPLICATIONS, VOL 2, 2010, : 407 - 412
  • [19] Emotion recognition from facial expressions using hybrid feature descriptors
    Kalsum, Tehmina
    Anwar, Syed Muhammad
    Majid, Muhammad
    Khan, Bilal
    Ali, Sahibzada Muhammad
    IET IMAGE PROCESSING, 2018, 12 (06) : 1004 - 1012
  • [20] RECOGNITION OF FACIAL EXPRESSION USING ACTION UNIT CLASSIFICATION TECHNIQUE
    Thuthi, D.
    2014 INTERNATIONAL CONFERENCE ON RECENT TRENDS IN INFORMATION TECHNOLOGY (ICRTIT), 2014,