A novel method for semi-automatic 2D to 3D video conversion

被引:15
作者
Wu, Chenglei [1 ]
Er, Guihua [1 ]
Xie, Xudong [1 ]
Li, Tao [1 ]
Cao, Xun [1 ]
Dai, Qionghai [1 ]
机构
[1] Tsinghua Univ, Broadband Networks & Digital Media Lab, Dept Automat, Beijing, Peoples R China
来源
2008 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO | 2008年
关键词
three-dimensional displays; image segmentation; stereo vision;
D O I
10.1109/3DTV.2008.4547809
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we present a novel semi-automatic method for converting monoscopic video to stereoscopic video. An efficient interactive image cutout tool is first used to segment the object-of-interest in the key frames. Then, we assign the initial depth information to the segmented objects. These objects are tracked in the whole video sequence through a bi-directional KLT (Kanade-Lucas-Tomashi) algorithm. In addition, depth interpolation is employed to produce the depth information in the non-key frames. Finally, stereoscopic video is synthesized in consideration of different 3D display types. The experimental results show that our method can fulfill 2D to 3D video conversion both reliably and efficiently.
引用
收藏
页码:45 / 48
页数:4
相关论文
共 15 条
[1]  
DIPLARIS S, 2002, INT C MULT EXP ICME, V2, P233
[2]  
DODGSON NA, 1999, INT BROADC CONV, P497
[3]   Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV [J].
Fehn, C .
STEREOSCOPIC DISPLAYS AND VIRTUAL REALITY SYSTEMS XI, 2004, 5291 :93-104
[4]  
HUMAN P, 2000, INT C IM PROC ICIP, V1, P1
[5]  
IDESES IA, 2007, P SPIE, V6490
[6]   SNAKES - ACTIVE CONTOUR MODELS [J].
KASS, M ;
WITKIN, A ;
TERZOPOULOS, D .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1987, 1 (04) :321-331
[7]   Stereoscopic conversion of monoscopic video by the transformation of vertical-to-horizontal disparity [J].
Kim, MB ;
Song, MS ;
Kim, DK ;
Choi, KC .
STEREOSCOPIC DISPLAYS AND VIRTUAL REALITY SYSTEMS V, 1998, 3295 :65-75
[8]  
LI Y, P ACM SIGGRAPH 2004, P303
[9]   Conversion system of monocular image sequence to stereo using motion parallax [J].
Matsumoto, Y ;
Terasaki, H ;
Sugimoto, K ;
Arakawa, T .
STEREOSCOPIC DISPLAYS AND VIRTUAL REALITY SYSTEMS IV, 1997, 3012 :108-115
[10]   Stereoscopic video generation based on efficient layered structure and motion estimation from a monoscopic image sequence [J].
Moustakas, K ;
Tzovaras, D ;
Strintzis, MG .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2005, 15 (08) :1065-1073