WTAOF-ILPB Based Feature Learning and LFSSOA-RBFNN Based Classification for Facial Micro-Expression Recognition

被引:0
作者
Rudranath Banerjee
Sourav De
Shouvik Dey
机构
[1] NIT Nagaland,Computer Science and Engineering
[2] CGEC,Computer Science and Engineering
关键词
Facial micro expression; Micro expression recognition (MER); Emotion recognition; Optical flow; Radial basis function neural network (RBFNN); Deep CNN;
D O I
暂无
中图分类号
学科分类号
摘要
Micro-Expressions (ME) has turned out to be one amongst the most vital clues for lies, as well as numerous other applications. It is the brief Facial Expressions (FE) that the people express whilst endeavouring to conceal, hide, or repress their emotions. In a real environment, recognizing facial ME is really very hard than recognizing the general-FE, which shows rich emotions. Here, to attain the most accurate classification outcomes of Micro-Expression Recognition (MER), a combination of Feature Learning (FL) algorithms is proposed. The Video Frames (VF) is taken as the input for MER. First, the inputted-VF is preprocessed and then a Viola-Jones Algorithm is carried out to attain the face images of the VF. The SB-DCNN extracts the Facial Land-Marks as of the face images. Next, for performing the effectual FL, the combination of Weight matrix-based Temporal Accumulated Optical Flow and Improved LBP features (WTAOF-ILPB) are employed. Lastly, to recognize the ME of the input VF, the features as of SB-DCNN and WTAOF-ILPB are rendered to the optimal adaptation of Radial Basis Function Neural Network (RBFNN), i.e. Levy Flight based Shuffled Shepherd Optimization Algorithm (LFSSOA)–RBFNN (LFSSOA-RBFNN). The proposed method’s performance is analyzed by executing an experiment. The outcomes exhibited that the proposed LFSSOA-RBFNN trounces other prevailing algorithms with respect to some performance metrics.
引用
收藏
页码:2285 / 2304
页数:19
相关论文
共 93 条
  • [1] Weber R(2019)A survey on databases of facial macro expression and micro expression Computer Vision, Imaging and Computer Graphics Theory and Applications 997 298-325
  • [2] Li J(2014)Background factors predicting accuracy and improvement in micro expression recognition Motivation and Emotion 38 700-714
  • [3] Soladie C(2018)A survey facial micro expression recognition Multimedia Tools and Applications 77 19301-19325
  • [4] Seguier R(2020)Multi-scale active patches fusion based on spatiotemporal LBP TOP for micro-expression recognition Journal of Visual Communication and Image Representation 71 1-10
  • [5] Hurley CM(2020)Micro expression recognition an updated review of current trends challenges and solutions The Visual Computer 36 445-468
  • [6] Anker AE(2020)Hierarchical support vector machine for facial micro-expression recognition Multimedia Tools and Applications 79 31451-31465
  • [7] Frank MG(2019)LEARNet dynamic imaging network for micro expression recognition IEEE Transactions on Image Processing 29 1618-1627
  • [8] Matsumoto D(2020)Manifold feature integration for micro-expression recognition Multimedia Systems 26 535-551
  • [9] Hwang HC(2018)Hybrid facial regions extraction for micro expression recognition system Journal of Signal Processing Systems 90 601-617
  • [10] Takalkar M(2017)CAS (ME)2) a database for spontaneous macro expression and micro expression spotting and recognition IEEE Transactions on Affective Computing 9 424-436