Facial Expression Recognition Based on Dual-Channel Fusion with Edge Features

被引:6
作者
Tang, Xiaoyu [1 ,2 ]
Liu, Sirui [1 ]
Xiang, Qiuchi [2 ]
Cheng, Jintao [1 ]
He, Huifang [3 ]
Xue, Bohuan [4 ]
机构
[1] South China Normal Univ, Sch Phys & Telecommun Engn, Guangzhou 510006, Peoples R China
[2] South China Normal Univ, Xingzhi Coll, Shanwei 516600, Peoples R China
[3] Guangdong Engn Polytech, Guangzhou 510520, Peoples R China
[4] Hong Kong Univ Sci & Technol, Dept Comp Sci & Engn, Hong Kong, Peoples R China
来源
SYMMETRY-BASEL | 2022年 / 14卷 / 12期
关键词
facial expression recognition; channel weighting; feature fusion; edge detection; SCALE;
D O I
10.3390/sym14122651
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
In the era of artificial intelligence, accomplishing emotion recognition in human-computer interaction is a key work. Expressions contain plentiful information about human emotion. We found that the canny edge detector can significantly help improve facial expression recognition performance. A canny edge detector based dual-channel network using the OI-network and EI-Net is proposed, which does not add an additional redundant network layer and training. We discussed the fusion parameters of alpha and beta using ablation experiments. The method was verified in CK+, Fer2013, and RafDb datasets and achieved a good result.
引用
收藏
页数:12
相关论文
共 35 条
[1]  
[Anonymous], 2010, 2010 IEEE COMPUTER S, DOI [10. 1109/CVPRW.2010.5543262, DOI 10.1109/CVPRW.2010.5543262]
[2]   Fusing Transformed Deep and Shallow features (FTDS) for image-based facial expression recognition [J].
Bougourzi, F. ;
Dornaika, F. ;
Mokrani, K. ;
Taleb-Ahmed, A. ;
Ruichek, Y. .
EXPERT SYSTEMS WITH APPLICATIONS, 2020, 156
[4]   Emotion Classification Using a Tensorflow Generative Adversarial Network Implementation [J].
Caramihale, Traian ;
Popescu, Dan ;
Ichim, Loretta .
SYMMETRY-BASEL, 2018, 10 (09)
[5]  
Carrier P.L., 2013, FER-2013 Face Database
[6]   Histograms of oriented gradients for human detection [J].
Dalal, N ;
Triggs, B .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :886-893
[7]   Multiple Attention Network for Facial Expression Recognition [J].
Gan, Yanling ;
Chen, Jingying ;
Yang, Zongkai ;
Xu, Luhui .
IEEE ACCESS, 2020, 8 :7383-7393
[8]  
Gao H., 2020, Front Signal Process, V4, P4, DOI [10.22606/fsp.2020.44001, DOI 10.22606/FSP.2020.44001]
[9]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[10]   Facial Expression Recognition Using Fusion Features Based on Center-Symmetric Local Octonary Pattern [J].
Hu, Min ;
Zheng, Yaqin ;
Yang, Chunjian ;
Wang, Xiaohua ;
He, Lei ;
Ren, Fuji .
IEEE ACCESS, 2019, 7 :29882-29890