Video Amplification and Deep Learning in Micro-Expression Recognition

被引：0

作者：

Liu R. ^{[1
]}

Xu D. ^{[1
]}

机构：

[1] School of Information, Yunnan University, Kunming

来源：

Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics | 2019年 / 31卷 / 09期

关键词：

Convolutional neural network; Emotion recognition; Micro-expression; Video amplification;

D O I：

10.3724/SP.J.1089.2019.17568

中图分类号：

学科分类号：

摘要：

To address the difficulty in identification of micro-expressions and low practical significance of consolidated emotional categories, a video amplification method based on eye interference elimination is proposed, and convolutional neural network (CNN) is used to realize micro-expression recognition. First, we amplify the video data of CASME, CASME II using phase-based video motion processing technology. Then, to eliminate eye interference, feature point location is used to obtain eye coordinates, and replace the original eye video into an enlarged video with fusion processing. Finally, the idea of VGG16 is used to construct CNN model, and identify emotion categories in the enlarged micro-expression data. Experiments compared the accuracy of two datasets under different methods as well as the accuracy of original and enlarged datasets under several models with different tuning strategies. The results show that the method can effectively improve the recognition accuracy under real emotion categories. © 2019, Beijing China Science Journal Publishing Co. Ltd. All right reserved.

引用

页码：1535 / 1541

页数：6

共 18 条

[1]

Haggard E.A., Isaacs K.S., Micromomentary facial expressions as indicators of ego mechanisms in psychotherapy, Methods of Research in Psychotherapy, pp. 154-165, (1966)

[2]

Porter S., Ten Brinke L., Reading between the lies: identifying concealed and falsified emotions in universal facial expressions, Psychological Science, 19, 5, pp. 508-514, (2008)

[3]

Yan W.J., Wu Q., Liang J., Et al., How fast are the leaked facial expressions: the duration of micro-expressions, Journal of Nonverbal Behavior, 37, 4, pp. 217-230, (2013)

[4]

Wu Q., Shen X., Fu X., Micro-expression and its applications, Advances in Psychological Science, 18, 9, pp. 1359-1368, (2010)

[5]

Li J.T., Soladie C., Seguier R., LTP-ML: micro-expression detection by recognition of local temporal pattern of facial movements, Proceedings of the 13th IEEE International Conference on Automatic Face & Gesture Recognition, pp. 634-641, (2018)

[6]

Barros J.M.D., Mirbach B., Garcia F., Et al., Fusion of keypoint tracking and facial landmark detection for real-time head pose estimation, Proceedings of the IEEE Winter Conference on Applications of Computer Vision, 1, pp. 2028-2037, (2018)

[7]

Xu F., Zhang J., Facial microexpression recognition: a survey, Acta Automatica Sinica, 43, 3, pp. 333-348, (2017)

[8]

Pfister T., Li X.B., Zhao G.Y., Et al., Recognising spontaneous facial micro-expressions, Proceedings of the IEEE International Conference on Computer Vision, pp. 1449-1456, (2011)

[9]

Xu F., Zhang J.P., Wang J.Z., Microexpression identification and categorization using a facial dynamics map, IEEE Transactions on Affective Computing, 8, 2, pp. 254-267, (2017)

[10]

Wang S.J., Yan W.J., Sun T.K., Et al., Sparse tensor canonical correlation analysis for micro-expression recognition, Neurocomputing, 214, pp. 218-232, (2016)

← 1 2 →