Augmenting panoramas with object movies by generating novel views with disparity-based view morphing

被引:12
作者
Hung, YP [1 ]
Chen, CS [1 ]
Tsai, YP [1 ]
Lin, SW [1 ]
机构
[1] Acad Sinica, Inst Informat Sci, Taipei 115, Taiwan
来源
JOURNAL OF VISUALIZATION AND COMPUTER ANIMATION | 2002年 / 13卷 / 04期
关键词
panorama; object movie; augmented reality; image-based rendering; novel view generation; disparity-based view morphing;
D O I
10.1002/vis.292
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Our goal is to augment a panorama with object movies in a visually 3D-consistent way. Notice that a panorama is recorded as one single 2D image and an object movie (OM) is composed of a set of 2D images taken around a 3D object. The challenge is how to integrate the above two sources of 2D images in a 3D-consistent way so that the user can easily manipulate object movies in a panorama. To solve this problem, we adopt a purely image-based approach that does not have to reconstruct the geometric models of the 3D objects to be inserted in the panorama. A critical issue of this method is how to generate the novel views required for showing an OM in different places of a panorama, and we have proposed a view morphing technique, called t-DBVM, to solve this problem. Our experiments have shown that this purely image-based approach can effectively generate visually convincing OM-augmented panoramas. This method has great potential for many applications that require integration of panoramas and object movies, such as virtual malls, virtual museum, and interior design. Copyright (C) 2002 John Wiley Sons, Ltd.
引用
收藏
页码:237 / 247
页数:11
相关论文
共 21 条
[1]  
[Anonymous], P 23 ANN C COMP GRAP
[2]  
CHEN CS, 1999, P 7 INT C COMP VIS I, P23
[3]  
CHEN CS, 2000, P 10 INT C ART REAL, P207
[4]  
Chen S. E., 1995, Computer Graphics Proceedings. SIGGRAPH 95, P29, DOI 10.1145/218380.218395
[5]  
Debevec P., 1998, Computer Graphics. Proceedings. SIGGRAPH 98 Conference Proceedings, P189, DOI 10.1145/280814.280864
[6]   Ego-motion and omnidirectional cameras [J].
Gluckman, J ;
Nayar, SK .
SIXTH INTERNATIONAL CONFERENCE ON COMPUTER VISION, 1998, :999-1005
[7]  
Gortler S. J., 1996, Computer Graphics Proceedings. SIGGRAPH '96, P43, DOI 10.1145/237170.237200
[8]   Panoramic stereo imaging system with automatic disparity warping and seaming [J].
Huang, HC ;
Hung, YP .
GRAPHICAL MODELS AND IMAGE PROCESSING, 1998, 60 (03) :196-208
[9]   Disparity-based view interpolation for multiple perspective stereoscopic displays [J].
Huang, HC ;
Kao, CC ;
Lin, YC ;
Hung, YP .
STEREOSCOPIC DISPLAYS AND VIRTUAL REALITY SYSTEMS VII, 2000, 3957 :102-113
[10]  
HUANG HC, 1998, P ACM S VIRT REAL SO, P9