3D Video-based Motion Capture using Convolutional Neural Networks

被引:0
作者
ShangGuan, Huyuan [1 ]
Mukundan, Ramakrishnan [1 ]
机构
[1] Univ Canterbury, Dept Comp Sci & Software Engn, Christchurch, New Zealand
来源
2017 INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ) | 2017年
关键词
3D motion capture; object detection; Convolutional neural networks; pose estimation;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper considers the problem of estimating three-dimensional motion of human actors from single view video sequences. This problem has received considerable attention in the recent past, since the motion capture data obtained from video sequences find applications in several domains of character animation. The problem becomes increasingly challenging when both the camera and the background are non-stationary. We propose a framework based on state-of-the-art Convolutional Neural Networks for object detection, estimation of positions of 2D anatomical landmarks and the reconstruction of 3D joint positions. Experimental results and analysis showing the effectiveness of the proposed framework in capturing motion from single-view video sequences are presented.
引用
收藏
页数:6
相关论文
共 19 条
[11]  
Pavlakos Georgios., 2016, CoRR
[12]  
Popa A.I., 2017, CVPR, V1, P5
[13]  
Ramakrishna V, 2012, LECT NOTES COMPUT SC, V7575, P573, DOI 10.1007/978-3-642-33765-9_41
[14]   Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks [J].
Ren, Shaoqing ;
He, Kaiming ;
Girshick, Ross ;
Sun, Jian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) :1137-1149
[15]  
Sigal Leonid., 2006, Humaneva: Synchronized video and motion capture dataset for evaluation of articulated human motion, P120
[16]   A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos [J].
Sobral, Andrews ;
Vacavant, Antoine .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2014, 122 :4-21
[17]   Learning to Segment and Track in RGBD [J].
Teichman, Alex ;
Lussier, Jake T. ;
Thrun, Sebastian .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2013, 10 (04) :841-852
[18]   Video-based 3D Motion Capture through Biped Control [J].
Vondrak, Marek ;
Sigal, Leonid ;
Hodgins, Jessica ;
Jenkins, Odest .
ACM TRANSACTIONS ON GRAPHICS, 2012, 31 (04)
[19]   Convolutional Pose Machines [J].
Wei, Shih-En ;
Ramakrishna, Varun ;
Kanade, Takeo ;
Sheikh, Yaser .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :4724-4732