High Speed and Accuracy of Animation 3D Pose Recognition Based on an Improved Deep Convolution Neural Network

被引:2
作者
Ding, Wei [1 ]
Li, Wenfa [2 ]
机构
[1] Anhui Normal Univ, Sch Journalism & Commun, Wuhu 241002, Peoples R China
[2] Univ Sci & Technol Beijing, Inst Artificial Intelligence, Beijing 100083, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2023年 / 13卷 / 13期
关键词
deep convolutional neural network (DCNN); pose recognition; character animation; complex posture; computer graphics;
D O I
10.3390/app13137566
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Pose recognition in character animations is an important avenue of research in computer graphics. However, the current use of traditional artificial intelligence algorithms to recognize animation gestures faces hurdles such as low accuracy and speed. Therefore, to overcome the above problems, this paper proposes a real-time 3D pose recognition system, which includes both facial and body poses, based on deep convolutional neural networks and further designs a single-purpose 3D pose estimation system. First, we transformed the human pose extracted from the input image to an abstract pose data structure. Subsequently, we generated the required character animation at runtime based on the transformed dataset. This challenges the conventional concept of monocular 3D pose estimation, which is extremely difficult to achieve. It can also achieve real-time running speed at a resolution of 384 fps. The proposed method was used to identify multiple-character animation using multiple datasets (Microsoft COCO 2014, CMU Panoptic, Human3.6M, and JTA). The results indicated that the improved algorithm improved the recognition accuracy and performance by approximately 3.5% and 8-10 times, respectively, which is significantly superior to other classic algorithms. Furthermore, we tested the proposed system on multiple pose-recognition datasets. The 3D attitude estimation system speed can reach 24 fps with an error of 100 mm, which is considerably less than that of the 2D attitude estimation system with a speed of 60 fps. The pose recognition based on deep learning proposed in this study yielded surprisingly superior performance, proving that the use of deep-learning technology for image recognition has great potential.
引用
收藏
页数:17
相关论文
共 48 条
[1]   A boosting framework for human posture recognition using spatio-temporal features along with radon transform [J].
Aftab, Salma ;
Ali, Syed Farooq ;
Mahmood, Arif ;
Suleman, Umar .
MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (29) :42325-42351
[2]   Machine learning and uLBP histograms for posture recognition of dependent people via Big Data Hadoop and Spark platform [J].
AlFayez, F. ;
Bouhamed, H. .
INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, 2023, 18 (01)
[3]   Automated brain tumor detection and segmentation using modified UNet and ResNet model [J].
Bindu, N. Phani ;
Sastry, P. Narahari .
SOFT COMPUTING, 2023, 27 (13) :9179-9189
[4]   Intelligent Posture Training: Machine-Learning-Powered Human Sitting Posture Recognition Based on a Pressure-Sensing IoT Cushion [J].
Bourahmoune, Katia ;
Ishac, Karlos ;
Amagasa, Toshiyuki .
SENSORS, 2022, 22 (14)
[5]   WSN-Driven Posture Recognition and Correction Towards Basketball Exercise [J].
Cai, Xiangyang .
INTERNATIONAL JOURNAL OF INFORMATION SYSTEM MODELING AND DESIGN, 2022, 13 (03)
[6]   Convolutional neural network initialization approaches for image manipulation detection [J].
Camacho, Ivan Castillo ;
Wang, Kai .
DIGITAL SIGNAL PROCESSING, 2022, 122
[7]   Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields [J].
Cao, Zhe ;
Simon, Tomas ;
Wei, Shih-En ;
Sheikh, Yaser .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1302-1310
[8]   Cascaded Pyramid Network for Multi-Person Pose Estimation [J].
Chen, Yilun ;
Wang, Zhicheng ;
Peng, Yuxiang ;
Zhang, Zhiqiang ;
Yu, Gang ;
Sun, Jian .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7103-7112
[9]  
Ding W.M.H., 2023, ENG ADV, V2, P194, DOI [10.26855/ea.2022.12.010, DOI 10.26855/EA.2022.12.010]
[10]   Learning to Detect and Track Visible and Occluded Body Joints in a Virtual World [J].
Fabbri, Matteo ;
Lanzi, Fabio ;
Calderara, Simone ;
Palazzi, Andrea ;
Vezzani, Roberto ;
Cucchiara, Rita .
COMPUTER VISION - ECCV 2018, PT IV, 2018, 11208 :450-466