Efficient facial expression recognition using histogram of oriented gradients in wavelet domain

被引:54
作者
Nigam, Swati [1 ]
Singh, Rajiv [2 ]
Misra, A. K. [1 ]
机构
[1] SP Mem Inst Technol, Comp Sci & Engn Dept, Kaushambi 212213, Uttar Pradesh, India
[2] Banasthali Vidyapith, Dept Comp Sci, Banasthali 304022, Rajasthan, India
关键词
Facial expression recognition; Discrete wavelet transform; HOG; Multiclass SVM; EXTREME LEARNING-MACHINE; HISTORY; IMAGE;
D O I
10.1007/s11042-018-6040-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Facial expression recognition plays a significant role in human behavior detection. In this study, we present an efficient and fast facial expression recognition system. We introduce a new feature called W_HOG where W indicates discrete wavelet transform and HOG indicates histogram of oriented gradients feature. The proposed framework comprises of four stages: (i) Face processing, (ii) Domain transformation, (iii) Feature extraction and (iv) Expression recognition. Face processing is composed of face detection, cropping and normalization steps. In domain transformation, spatial domain features are transformed into the frequency domain by applying discrete wavelet transform (DWT). Feature extraction is performed by retrieving Histogram of Oriented Gradients (HOG) feature in DWT domain which is termed as W_HOG feature. For expression recognition, W_HOG feature is supplied to a well-designed tree based multiclass support vector machine (SVM) classifier with one-versus-all architecture. The proposed system is trained and tested with benchmark CK+, JAFFE and Yale facial expression datasets. Experimental results of the proposed method are effective towards facial expression recognition and outperforms existing methods.
引用
收藏
页码:28725 / 28747
页数:23
相关论文
共 70 条
[41]   From action to activity: Sensor-based activity recognition [J].
Liu, Ye ;
Nie, Liqiang ;
Liu, Li ;
Rosenblum, David S. .
NEUROCOMPUTING, 2016, 181 :108-115
[42]   Facial expression recognition with Convolutional Neural Networks: Coping with few data and the training sample order [J].
Lopes, Andre Teixeira ;
de Aguiar, Edilson ;
De Souza, Alberto F. ;
Oliveira-Santos, Thiago .
PATTERN RECOGNITION, 2017, 61 :610-628
[43]  
Lucey P., 2010, 2010 IEEE COMPUTER S, P94, DOI [10.1109/cvprw.2010.5543262, DOI 10.1109/CVPRW.2010.5543262]
[44]  
Malisiewicz T, 2011, IEEE I CONF COMP VIS, P89, DOI 10.1109/ICCV.2011.6126229
[45]   Identity-Aware Convolutional Neural Network for Facial Expression Recognition [J].
Meng, Zibo ;
Liu, Ping ;
Cai, Jie ;
Han, Shizhong ;
Tong, Yan .
2017 12TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION (FG 2017), 2017, :558-565
[46]  
Nigam S, 2018, ADV COMPUTER VISION, P34
[47]   Integration of moment invariants and uniform local binary patterns for human activity recognition in video sequences [J].
Nigam, Swati ;
Khare, Ashish .
MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (24) :17303-17332
[48]   Multiresolution approach for multiple human detection using moments and local binary patterns [J].
Nigam, Swati ;
Khare, Ashish .
MULTIMEDIA TOOLS AND APPLICATIONS, 2015, 74 (17) :7037-7062
[49]   Multiscale Local Binary Patterns for Facial Expression-Based Human Emotion Recognition [J].
Nigam, Swati ;
Khare, Ashish .
COMPUTATIONAL VISION AND ROBOTICS, 2015, 332 :71-77
[50]   Subclass discriminant Nonnegative Matrix Factorization for facial image analysis [J].
Nikitidis, Symeon ;
Tefas, Anastasios ;
Nikolaidis, Nikos ;
Pitas, Ioannis .
PATTERN RECOGNITION, 2012, 45 (12) :4080-4091