Optimization of facial expression recognition based on dual attention mechanism by lightweight network model

被引:2
作者
Fang, Jian [1 ,2 ]
Lin, Xiaomei [3 ]
Wu, Yue [4 ]
An, Yi [5 ]
Sun, Haoran [2 ]
机构
[1] Changchun Univ Technol, Sch Mech & Elect Engn, Changchun, Peoples R China
[2] Jilin Commun Polytech, Changchun, Peoples R China
[3] Changchun Univ Technol, Sch Elect & Elect Engn, Changchun, Peoples R China
[4] Jilin Univ, Sch Artificial Intelligence, Changchun, Peoples R China
[5] Jilin Engn Normal Univ, Sch Elect & Informat Engn, Changchun, Peoples R China
关键词
ResNet50; SE; CBAM; depth separability; lightweight;
D O I
10.3233/JIFS-230524
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As a deep learning network model, ResNet50 can effectively recognize facial expressions to a certain extent, but there are still problems such as insufficient extraction of local effective feature information and a large number of parameters. In this paper, we take ResNet50 as the basic framework to optimize and improve this network. Firstly, by analyzing the influence mechanism of the attention mechanism module on the network feature information circulation, the optimal embedding position of CBAM (Convolutional Block Attention Module) and SE modules in the ResNet50 network is thus determined to effectively extract local key information, and then the number of model parameters is effectively reduced by embedding the depth separable module. To validate the performance of the improved ResNet50 model, the recognition accuracy reached 71.72% and 95.72% by ablation experiments using Fer2013 and CK+ datasets, respectively. We then used the trained model to classify the homemade dataset, and the recognition accuracy reached 92.86%. In addition, compared with the current more advanced methods, the improved ResNet50 network model proposed in this paper can maintain a balance between model complexity and recognition ability and can provide a technical reference for facial expression recognition research.
引用
收藏
页码:9069 / 9081
页数:13
相关论文
共 32 条
[1]  
Bah I., 2022, Intell. Robot, V2, P78, DOI [10.20517/ir.2021.16, DOI 10.20517/IR.2021.16]
[2]   ACTIVE SHAPE MODELS - THEIR TRAINING AND APPLICATION [J].
COOTES, TF ;
TAYLOR, CJ ;
COOPER, DH ;
GRAHAM, J .
COMPUTER VISION AND IMAGE UNDERSTANDING, 1995, 61 (01) :38-59
[3]   Histograms of oriented gradients for human detection [J].
Dalal, N ;
Triggs, B .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :886-893
[4]  
Goodfellow Ian J., 2013, Neural Information Processing. 20th International Conference, ICONIP 2013. Proceedings: LNCS 8228, P117, DOI 10.1007/978-3-642-42051-1_16
[5]   Deep Neural Networks with Relativity Learning for Facial Expression Recognition [J].
Guo, Yanan ;
Tao, Dapeng ;
Yu, Jun ;
Xiong, Hao ;
Li, Yaotang ;
Tao, Dacheng .
2016 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2016,
[6]  
Han S., 2016, P INT C LEARN REPR I, P1
[7]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[8]   Automatic depression recognition using CNN with attention mechanism from videos [J].
He, Lang ;
Chan, Jonathan Cheung-Wai ;
Wang, Zhongmin .
NEUROCOMPUTING, 2021, 422 :165-175
[9]  
Howard Andrew G., 2017, C COMP VIS PATT REC
[10]   AN EVALUATION OF THE TWO-DIMENSIONAL GABOR FILTER MODEL OF SIMPLE RECEPTIVE-FIELDS IN CAT STRIATE CORTEX [J].
JONES, JP ;
PALMER, LA .
JOURNAL OF NEUROPHYSIOLOGY, 1987, 58 (06) :1233-1258