Synchronization of images from multiple cameras to reconstruct a moving human

被引:8
作者
Moore, Carl [1 ]
Duckworth, Toby [1 ]
Aspin, Rob [1 ]
Roberts, David [1 ]
机构
[1] Univ Salford, Ctr Virtual Environm & Future Media, Salford M5 4WT, Lancs, England
来源
14TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON DISTRIBUTED SIMULATION AND REAL-TIME APPLICATIONS (DS-RT 2010) | 2010年
关键词
tele-immersion; telepresence; 3D reconstruction; synchronisation;
D O I
10.1109/DS-RT.2010.15
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
What level of synchronization is necessary between images from multiple cameras in order to realistically reconstruct a moving human in 3D? Live reconstruction of the human form, from cameras surrounding the subject, could bridge the gap between video conferencing and Immersive Collaborative Virtual Environments (ICVEs). Video conferencing faithfully reproduces what someone looks like whereas ICVE faithfully reproduces what they look at. While 3D video has been demonstrated in tele-immersion prototypes, the visual/temporal quality has been way below what has become acceptable in video conferencing. Managed synchronization of the acquisition stage is universally used today to ensure multiple images feeding the reconstruction algorithm were taken at the same time. However, this inevitably increases latency and jitter. We measure the temporal characteristics of the capture stage and the impact of inconsistency on the reconstruction algorithm this feeds. This gives us both input and output characteristics for synchronization. From this we determine whether frame synchronization of multiple camera video streams actually needs to be delivered for 3D reconstruction, and if not what level of temporal divergence is acceptable across the captured image frames.
引用
收藏
页码:53 / 60
页数:8
相关论文
共 10 条
[1]  
ASPIN R, 2010, 7 EUR C VIS MED PROD
[2]  
BELLARD F, FFMPEG LIB
[3]   A combined studio production system for 3-D capturing of live action and immersive actor feedback [J].
Grau, O ;
Pullen, T ;
Thomas, GA .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2004, 14 (03) :370-380
[4]   blue-c:: A spatially immersive display and 3D video portal for telepresence [J].
Gross, M ;
Würmlin, S ;
Naef, M ;
Lamboray, E ;
Spagno, C ;
Kunz, A ;
Koller-Meier, E ;
Svoboda, T ;
Van Gool, L ;
Lang, S ;
Strehlke, K ;
Vande Moere, A ;
Staadt, O .
ACM TRANSACTIONS ON GRAPHICS, 2003, 22 (03) :819-827
[5]   THE TIMING OF SHIFTS OF HEAD POSTURES DURING CONVERSATION [J].
HADAR, U ;
STEINER, TJ ;
GRANT, EC ;
ROSE, FC .
HUMAN MOVEMENT SCIENCE, 1984, 3 (03) :237-245
[6]  
LEUNG C, 2007, HEAD EYE BOLLS TEETH
[7]  
Lorensen W, 1987, 14 ANN C COMP GRAPH
[8]  
MATSUYAMA T, 2004, IEEE T CIRCUITS SYST, V14, P257
[9]  
ROBERTS D, 2009, P 2009 IEEE VIRT REA
[10]  
TOWLES H, 2003, NSF WORKSH COLL VIRT