Depth Map Estimation Using Defocus and Motion Cues

被引:19
作者
Kumar, Himanshu [1 ]
Yadav, Ajeet Singh [2 ]
Gupta, Sumana [1 ]
Venkatesh, K. S. [1 ]
机构
[1] IIT Kanpur, Dept Elect Engn, Kanpur 208011, Uttar Pradesh, India
[2] Stryker Global Technol Ctr, Gurgaon 122002, India
关键词
Depth from defocus; depth from motion; motion and defocus; depth for video; monocular depth; 2D-to-3D; 3DTV; integration of defocus and motion; PSF based integration; EDGE-DETECTION; CONVERSION; RECOVERY;
D O I
10.1109/TCSVT.2018.2832086
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Significant recent developments in 3D display technology have focused on techniques for converting 2D media into 3D. Depth map is an integral part of 2D-to-3D conversion. Combining multiple depth cues results in a more accurate depth map as it compensates for the errors caused by one depth cue as well as its absence by other depth cues. In this paper, we present a novel framework to generate a more accurate depth map for video using defocus and motion cues. The moving objects present in the scene are the source of errors in both defocus and motion-based depth map estimation. The proposed method rectifies these errors in the depth map by integrating defocus blur and motion cues. In addition, it also corrects the errors in other parts of depth map caused by inaccurate estimation of defocus blur and motion. Since the proposed integration approach relies on the characteristics of point spread functions of defocus and motion blur along with their relations to camera parameters, it is more accurate and reliable.
引用
收藏
页码:1365 / 1379
页数:15
相关论文
共 39 条
[1]  
[Anonymous], 1980, TECH REP
[2]  
[Anonymous], P IEEE C COMP VIS PA
[3]  
[Anonymous], 2017, 2017 22 INT C DIG SI
[4]  
[Anonymous], 2004, FLAIRS
[5]  
[Anonymous], 2017, IEEE CVPR 2017
[6]  
[Anonymous], DEPTH EXTRACTION VID
[7]  
[Anonymous], PROC IS T SPIE
[8]  
[Anonymous], P IEEE INT TEL S ITS
[9]   Defocus magnification [J].
Bac, Soorimin ;
Durand, Fredo .
COMPUTER GRAPHICS FORUM, 2007, 26 (03) :571-579
[10]   A Database and Evaluation Methodology for Optical Flow [J].
Baker, Simon ;
Scharstein, Daniel ;
Lewis, J. P. ;
Roth, Stefan ;
Black, Michael J. ;
Szeliski, Richard .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2011, 92 (01) :1-31