Facial Expression Recognition Using Fusion Features Based on Center-Symmetric Local Octonary Pattern

被引:15
作者
Hu, Min [1 ]
Zheng, Yaqin [1 ]
Yang, Chunjian [1 ]
Wang, Xiaohua [1 ]
He, Lei [2 ]
Ren, Fuji [1 ,3 ]
机构
[1] Hefei Univ Technol, Sch Comp & Informat, Anhui Prov Key Lab Affect Comp & Adv Intelligent, Hefei 230602, Anhui, Peoples R China
[2] Hefei Univ Technol, Sch Math, Hefei 230602, Anhui, Peoples R China
[3] Univ Tokushima, Grad Sch Adv Technol & Sci, Tokushima 7708502, Japan
基金
中国国家自然科学基金;
关键词
Facial expression recognition; feature extraction; center-symmetric local octonary pattern; feature fusion; ALGORITHM;
D O I
10.1109/ACCESS.2019.2899024
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A local feature descriptor has gained a lot of interest in many applications, such as image retrieval, texture classification, and face recognition. This paper proposes a novel local feature descriptor: center-symmetric local octonary pattern (CS-LOP) for facial expression recognition. A CS-LOP operator not only considers the difference of the gray value between central pixels and neighboring pixels in all eight directions but also compares the gray value of four pairs of center-symmetric pixels. Besides, this paper used the CS-LOP to extract diverse features from the preprocessed facial image, the feature map of gradient magnitude, and the feature map of Gabor, and also to make extracted features more abundant and detailed. To evaluate the performance of the proposed method, experiments on JAFFE and CK facial expression datasets demonstrate that the proposed method outperforms the method using the individual descriptor. Compared with other state-of-the-art methods, our approach improves the overall recognition accuracy.
引用
收藏
页码:29882 / 29890
页数:9
相关论文
共 52 条
[1]  
Abe S, 2010, ADV PATTERN RECOGNIT, P331, DOI 10.1007/978-1-84996-098-4_7
[2]  
[Anonymous], 2014, PROCEDIA IEEE COMPUT, DOI [DOI 10.1109/CVPR.2014.233, 10.1109/CVPR.2014.233]
[3]  
[Anonymous], 2016, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2016.322
[4]   Facial expression recognition based on image pyramid and single-branch decision tree [J].
Ashir, Abubakar M. ;
Eleyan, Alaa .
SIGNAL IMAGE AND VIDEO PROCESSING, 2017, 11 (06) :1017-1024
[5]  
Bhatt Himanshu S., 2010, 2010 Fourth IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS), P1
[6]   Facial Expression Recognition in JAFFE Dataset Based on Gaussian Process Classification [J].
Cheng, Fei ;
Yu, Jiangsheng ;
Xiong, Huilin .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2010, 21 (10) :1685-1690
[7]  
Chew Sien W., 2011, Proceedings 2011 IEEE International Conference on Automatic Face & Gesture Recognition (FG 2011), P915, DOI 10.1109/FG.2011.5771373
[8]   ACTIVE SHAPE MODELS - THEIR TRAINING AND APPLICATION [J].
COOTES, TF ;
TAYLOR, CJ ;
COOPER, DH ;
GRAHAM, J .
COMPUTER VISION AND IMAGE UNDERSTANDING, 1995, 61 (01) :38-59
[9]   Active appearance models [J].
Cootes, TF ;
Edwards, GJ ;
Taylor, CJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (06) :681-685
[10]  
Cossetin MJ, 2016, IEEE IJCNN, P5149, DOI 10.1109/IJCNN.2016.7727879