Context Based Vision Emotion Recognition in the Wild

被引:1
作者
Yuan, Ying [1 ]
Lu, Fei [1 ]
Cheng, Xianpeng [1 ]
Liu, Yuhong [1 ]
机构
[1] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
来源
2022 IEEE 17TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA) | 2022年
基金
中国国家自然科学基金;
关键词
emotion recognition; attention; context; deep learning;
D O I
10.1109/ICIEA54703.2022.10005917
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
With the development of computer science and the increasing demand for personalized human-computer interaction, emotional computing plays an increasingly significant role in human-computer interaction. However, most researches at the present stage focus on facial expression recognition, which makes it difficult to recognize emotions in the wild. In this paper, a method of emotion recognition using both facial expression and the context is proposed to solve the difficulties of facial expression recognition such as occlusion and misalignment in the wild. A multi-head cross attention network (MHCAN) is proposed to distinguish more subtle changes in expression and improve the accuracy of emotion recognition. Our network is tested on CAERS and RAF-DB datasets, and compared with advanced methods, the effectiveness of our method is proved.
引用
收藏
页码:479 / 484
页数:6
相关论文
共 24 条
[1]  
[Anonymous], 2010, 2010 IEEE COMPUTER S, DOI [10. 1109/CVPRW.2010.5543262, DOI 10.1109/CVPRW.2010.5543262]
[2]   EmotioNet: An accurate, real-time algorithm for the automatic annotation of a million facial expressions in the wild [J].
Benitez-Quiroz, C. Fabian ;
Srinivasan, Ramprakash ;
Martinez, Aleix M. .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :5562-5570
[3]   IDENTITY-FREE FACIAL EXPRESSION RECOGNITION USING CONDITIONAL GENERATIVE ADVERSARIAL NETWORK [J].
Cai, Jie ;
Meng, Zibo ;
Khan, Ahmed Shehab ;
O'Reilly, James ;
Li, Zhiyuan ;
Han, Shizhong ;
Tong, Yan .
2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, :1344-1348
[4]   Facial Expression Recognition in the Wild via Deep Attentive Center Loss [J].
Farzaneh, Amir Hossein ;
Qi, Xiaojun .
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, :2401-2410
[5]   Discriminant Distribution-Agnostic Loss for Facial Expression Recognition in the Wild [J].
Farzaneh, Amir Hossein ;
Qi, Xiaojun .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :1631-1639
[6]  
Goodfellow Ian J., 2013, Neural Information Processing. 20th International Conference, ICONIP 2013. Proceedings: LNCS 8228, P117, DOI 10.1007/978-3-642-42051-1_16
[7]  
Jeon Jinwoo, 2016, P 10 INT C UB INF MA
[8]   Context Based Emotion Recognition Using EMOTIC Dataset [J].
Kosti, Ronak ;
Alvarez, Jose M. ;
Recasens, Adria ;
Lapedriza, Agata .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (11) :2755-2766
[9]   Context-Aware Emotion Recognition Networks [J].
Lee, Jiyoung ;
Kim, Seungryong ;
Kim, Sunok ;
Park, Jungin ;
Sohn, Kwanghoon .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :10142-10151
[10]  
Li HX, 2015, PROC CVPR IEEE, P5325, DOI 10.1109/CVPR.2015.7299170