Heuristic objective for facial expression recognition

被引:12
作者
Li, Huihui [1 ]
Xiao, Xiangling [1 ]
Liu, Xiaoyong [1 ]
Guo, Jianhua [1 ]
Wen, Guihua [2 ]
Liang, Peng [1 ]
机构
[1] Guangdong Polytech Normal Univ, Sch Comp Sci, Guangzhou 510665, Peoples R China
[2] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510064, Peoples R China
基金
中国国家自然科学基金;
关键词
Facial expression recognition; Domain knowledge; Objective function; Heuristics; FACE; NETWORK;
D O I
10.1007/s00371-022-02619-7
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Facial expression recognition has been widely used in lots of fields such as health care and intelligent robot systems. However, recognizing facial expression in the wild is still very challenging due to variations, light intensity, occlusions and the ambiguity of human emotion. When training samples cannot include all these environments, the classification can easily lead to errors. Therefore, this paper proposes a new heuristic objective function based on the domain knowledge so as to better optimize deep neural networks for facial expression recognition. Moreover, we take the specific relationship between the facial expression and facial action units as the domain knowledge. By analyzing the mixing relationship between different expression categories and then enlarging the distance of easily confused categories, we define a new heuristic objective function which can guide deep neural network to learn better features and then improve the accuracy of facial expression recognition. The experimental results verify the effectiveness, universality and the superior performance of our methods.
引用
收藏
页码:4709 / 4720
页数:12
相关论文
共 59 条
[11]   Knowledge-Embedded Routing Network for Scene Graph Generation [J].
Chen, Tianshui ;
Yu, Weihao ;
Chen, Riquan ;
Lin, Liang .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :6156-6164
[12]   ArcFace: Additive Angular Margin Loss for Deep Face Recognition [J].
Deng, Jiankang ;
Guo, Jia ;
Xue, Niannan ;
Zafeiriou, Stefanos .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :4685-4694
[13]  
Dhall A, 2011, 2011 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCV WORKSHOPS)
[14]   CONSTANTS ACROSS CULTURES IN FACE AND EMOTION [J].
EKMAN, P ;
FRIESEN, WV .
JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY, 1971, 17 (02) :124-&
[15]  
Ekman P., 1978, FACIAL ACTION CODING, DOI [10.1037/t27734-000, DOI 10.1037/T27734-000]
[16]  
Ekman P., 1997, What the face reveals: Basic and applied studies of spontaneous expression using the Facial Action Coding System (FACS)
[17]   Deep Neural Network Architecture: Application for Facial Expression Recognition [J].
Garcia, M. ;
Ramirez, S. .
IEEE LATIN AMERICA TRANSACTIONS, 2020, 18 (07) :1311-1319
[18]   CERN: Compact facial expression recognition net [J].
Gera, Darshan ;
Balasubramanian, S. ;
Jami, Anwesh .
PATTERN RECOGNITION LETTERS, 2022, 155 :9-18
[19]  
Goodfellow Ian J., 2013, Neural Information Processing. 20th International Conference, ICONIP 2013. Proceedings: LNCS 8228, P117, DOI 10.1007/978-3-642-42051-1_16
[20]   Facial expression and action unit recognition augmented by their dependencies on graph convolutional networks [J].
He, Jun ;
Yu, Xiaocui ;
Sun, Bo ;
Yu, Lejun .
JOURNAL ON MULTIMODAL USER INTERFACES, 2021, 15 (04) :429-440