A-MobileNet: An approach of facial expression recognition

被引:85
|
作者
Nan, Yahui [1 ,2 ]
Ju, Jianguo [1 ]
Hua, Qingyi [1 ]
Zhang, Haoming [1 ]
Wang, Bo [1 ]
机构
[1] Northwest Univ, Sch Informat Sci & Technol, Xian 710027, Peoples R China
[2] Lvliang Univ, Dept Comp Sci & Technol, Lvliang 033000, Peoples R China
关键词
Attention module; Center loss; Facial expression recognition; Channel attention; Spatial attention;
D O I
10.1016/j.aej.2021.09.066
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Facial expression recognition (FER) is to separate the specific expression state from the given static image or video to determine the psychological emotions of the recognized object, the realization of the computer's understanding and recognition of facial expressions have fundamentally changed the relationship between human and computer, to achieve better human computer interaction (HCI). In recent years, FER has attracted widespread attention in the fields of HCI, security, communications and driving, and has become one of the research hotspots. In the mobile Internet era, the need for lightweight networking and real-time performance is growing. In this paper, a lightweight A-MobileNet model is proposed. First, the attention module is introduced into the MobileNetV1 model to enhance the local feature extraction of facial expressions. Then, the center loss and softmax loss are combined to optimize the model parameters to reduce intra-class distance and increase inter-class distance. Compared with the original MobileNet series models, our method significantly improves recognition accuracy without increasing the number of model parameters. Compared with others, A-MobileNet model achieves better results on the FERPlus and RAF-DB datasets. (C) 2021 THE AUTHORS. Published by Elsevier BV on behalf of Faculty of Engineering, Alexandria University.
引用
收藏
页码:4435 / 4444
页数:10
相关论文
共 50 条
  • [31] Facial Expression Recognition: A Survey
    Huang, Yunxin
    Chen, Fei
    Lv, Shaohe
    Wang, Xiaodong
    SYMMETRY-BASEL, 2019, 11 (10):
  • [32] Facial expression recognition: a review
    Xing Guo
    Yudong Zhang
    Siyuan Lu
    Zhihai Lu
    Multimedia Tools and Applications, 2024, 83 : 23689 - 23735
  • [33] A Deep Learning Approach to Facial Expression Recognition in the Presence of Masked Occlusion
    Thavarekere, Shree R.
    Hebbar, Anushka
    Uma, D.
    2022 IEEE 19TH INDIA COUNCIL INTERNATIONAL CONFERENCE, INDICON, 2022,
  • [34] Occlusion-aware facial expression recognition: A deep learning approach
    Naveen, Palanichamy
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (11) : 32895 - 32921
  • [35] A Human Facial Expression Recognition Model based on Eigen Face Approach
    De, Anurag
    Saha, Ashim
    Pal, M. C.
    INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING TECHNOLOGIES AND APPLICATIONS (ICACTA), 2015, 45 : 282 - 289
  • [36] Complexity aware center loss for facial expression recognition
    Li, Huihui
    Yuan, Xu
    Xu, Chunlin
    Zhang, Rui
    Liu, Xiaoyong
    Liu, Lianqi
    VISUAL COMPUTER, 2024, 40 (11) : 8045 - 8054
  • [37] Facial Expression Recognition Based on Local Facial Regions
    Nan, Zhang
    Xue, Geng
    2011 IET 4TH INTERNATIONAL CONFERENCE ON WIRELESS, MOBILE & MULTIMEDIA NETWORKS (ICWMMN 2011), 2011, : 262 - 265
  • [38] A Triple-Structure Network Model Based upon MobileNet V1 and Multi-Loss Function for Facial Expression Recognition
    Han, Baojin
    Hu, Min
    Wang, Xiaohua
    Ren, Fuji
    SYMMETRY-BASEL, 2022, 14 (10):
  • [39] Facial Expression Recognition Based on Facial Action Unit
    Yang, Jiannan
    Zhang, Fan
    Chen, Bike
    Khan, Samee U.
    2019 TENTH INTERNATIONAL GREEN AND SUSTAINABLE COMPUTING CONFERENCE (IGSC), 2019,
  • [40] Impact of Facial Landmark Localization on Facial Expression Recognition
    Belmonte, Romain
    Allaert, Benjamin
    Tirilly, Pierre
    Bilasco, Ioan Marius
    Djeraba, Chaabane
    Sebe, Nicu
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (02) : 1267 - 1279