VideoMocap: Modeling Physically Realistic Human Motion from Monocular Video Sequences

被引：53

作者：

Wei, Xiaolin ^{[1
]}

Chai, Jinxiang ^{[1
]}

机构：

[1] Texas A&M Univ, College Stn, TX 77843 USA

来源：

ACM TRANSACTIONS ON GRAPHICS | 2010年 / 29卷 / 04期

基金：

美国国家科学基金会;

关键词：

Video-based motion capture; performance animation; physics-based animation; data-driven animation; interactive 3D visual tracking; vision for graphics;

D O I：

10.1145/1778765.1778779

中图分类号：

TP31 [计算机软件];

学科分类号：

081202 ; 0835 ;

摘要：

This paper presents a video-based motion modeling technique for capturing physically realistic human motion from monocular video sequences. We formulate the video-based motion modeling process in an image-based keyframe animation framework. The system first computes camera parameters, human skeletal size, and a small number of 3D key poses from video and then uses 2D image measurements at intermediate frames to automatically calculate the "in between" poses. During reconstruction, we leverage Newtonian physics, contact constraints, and 2D image measurements to simultaneously reconstruct full-body poses, joint torques, and contact forces. We have demonstrated the power and effectiveness of our system by generating a wide variety of physically realistic human actions from uncalibrated monocular video sequences such as sports video footage.

引用

页数：10

共 33 条

[1] Recovering 3D human pose from monocular images [J].

Agarwal, A ;

Triggs, B .

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (01) :44-58

[2]

[Anonymous], P IEEE C CVPR JUN

[3]

Bazaraa M. S., 2006, NONLINEAR PROGRAMMIN

[4] Twist based acquisition and tracking of animal and human kinematics [J].

Bregler, C ;

Malik, J ;

Pullen, K .

INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 56 (03) :179-194

[5] Performance animation from low-dimensional control signals [J].

Chai, JX ;

Hodgins, JK .

ACM TRANSACTIONS ON GRAPHICS, 2005, 24 (03) :686-696

[6]

CHEN YL, 2009, P 9 AS C COMP VIS

[7]

COHEN MF, 1992, COMP GRAPH, V26, P293

[8] Mean shift: A robust approach toward feature space analysis [J].

Comaniciu, D ;

Meer, P .

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (05) :603-619

[9]

COWLEY A, 2001, VIDEOMOCAP VIDEO BAS

[10]

DiFranco DE, 2001, PROC CVPR IEEE, P307

← 1 2 3 4 →