Expression dynamic capture and 3D animation generation method based on deep learning

被引:4
作者
Wang, Baoqing [1 ]
Shi, Yujie [1 ]
机构
[1] Zhejiang Wan Li Univ, ZWU Fac Design & Architecture, Ningbo 315100, Zhejiang, Peoples R China
关键词
Deep learning; Facial expression dynamic capture; 3D animation; Facial expression recognition;
D O I
10.1007/s00521-022-07644-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of computer technology and artificial intelligence today, human-computer interaction based solely on computer software operations is far from being able to meet human requirements for computer use. People are looking forward to a more convenient and fast human-computer interface. This paper studies the expression dynamic capture and 3D animation generation methods based on deep learning. For facial expression dynamic capture, this paper proposes a facial feature extraction algorithm based on deep learning and uses SVM technology for feature classification. For 3D animation, C++ and OpenGL are used for rendering simulation. The experimental results show that the face detection algorithm proposed in this paper has good performance in both accuracy and speed. It can realize real-time detection of face regions in video images.
引用
收藏
页码:8797 / 8808
页数:12
相关论文
共 22 条
[1]   Facial expression recognition using adapted residual based deep neural network [J].
Bah, Ibrahima ;
Xue, Yu .
INTELLIGENCE & ROBOTICS, 2022, 2 (01) :72-88
[2]  
Chen Hua Y, 2020, Instrumentation, V7, P35
[3]   Deep Learning-Based Classification of Hyperspectral Data [J].
Chen, Yushi ;
Lin, Zhouhan ;
Zhao, Xing ;
Wang, Gang ;
Gu, Yanfeng .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2014, 7 (06) :2094-2107
[4]   Deep learning ensembles for melanoma recognition in dermoscopy images [J].
Codella, N. C. F. ;
Nguyen, Q. -B. ;
Pankanti, S. ;
Gutman, D. A. ;
Helba, B. ;
Halpern, A. C. ;
Smith, J. R. .
IBM JOURNAL OF RESEARCH AND DEVELOPMENT, 2017, 61 (4-5)
[5]   Three-dimensional evaluation of smile characteristics in subjects with increased vertical facial dimensions [J].
Demir, Rana ;
Baysal, Asli .
AMERICAN JOURNAL OF ORTHODONTICS AND DENTOFACIAL ORTHOPEDICS, 2020, 157 (06) :773-782
[6]   Person-independent facial expression recognition based on the fusion of HOG descriptor and cuttlefish algorithm [J].
Hussein, Haval I. ;
Dino, Hivi Ismat ;
Mstafa, Ramadhan J. ;
Hassan, Masoud Muhammed .
MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (08) :11563-11586
[7]  
Indira, 2021, IOP C SER MAT SCI EN, V1074
[8]   Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning [J].
Kermany, Daniel S. ;
Goldbaum, Michael ;
Cai, Wenjia ;
Valentim, Carolina C. S. ;
Liang, Huiying ;
Baxter, Sally L. ;
McKeown, Alex ;
Yang, Ge ;
Wu, Xiaokang ;
Yan, Fangbing ;
Dong, Justin ;
Prasadha, Made K. ;
Pei, Jacqueline ;
Ting, Magdalena ;
Zhu, Jie ;
Li, Christina ;
Hewett, Sierra ;
Dong, Jason ;
Ziyar, Ian ;
Shi, Alexander ;
Zhang, Runze ;
Zheng, Lianghong ;
Hou, Rui ;
Shi, William ;
Fu, Xin ;
Duan, Yaou ;
Huu, Viet A. N. ;
Wen, Cindy ;
Zhang, Edward D. ;
Zhang, Charlotte L. ;
Li, Oulan ;
Wang, Xiaobo ;
Singer, Michael A. ;
Sun, Xiaodong ;
Xu, Jie ;
Tafreshi, Ali ;
Lewis, M. Anthony ;
Xia, Huimin ;
Zhang, Kang .
CELL, 2018, 172 (05) :1122-+
[9]   Joint Local and Global Information Learning With Single Apex Frame Detection for Micro-Expression Recognition [J].
Li, Yante ;
Huang, Xiaohua ;
Zhao, Guoying .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :249-263
[10]   The effect of face masks and sunglasses on identity and expression recognition with super-recognizers and typical observers [J].
Noyes, Eilidh ;
Davis, Josh P. ;
Petrov, Nikolay ;
Gray, Katie L. H. ;
Ritchie, Kay L. .
ROYAL SOCIETY OPEN SCIENCE, 2021, 8 (03)