Deep Depth from Defocus: How Can Defocus Blur Improve 3D Estimation Using Dense Neural Networks?

被引:16
作者
Carvalho, Marcela [1 ]
Le Saux, Bertrand [1 ]
Trouve-Peloux, Pauline [1 ]
Almansa, Andres [2 ]
Champagnat, Frederic [2 ]
机构
[1] Univ Paris Saclay, DTIS, ONERA, F-91123 Palaiseau, France
[2] Univ Paris 05, F-75006 Paris, France
来源
COMPUTER VISION - ECCV 2018 WORKSHOPS, PT I | 2019年 / 11129卷
关键词
Depth from defocus; Domain adaptation; Depth estimation; Single-image depth prediction; BLIND DECONVOLUTION;
D O I
10.1007/978-3-030-11009-3_18
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Depth estimation is critical interest for scene understanding and accurate 3D reconstruction. Most recent approaches with deep learning exploit geometrical structures of standard sharp images to predict depth maps. However, cameras can also produce images with defocus blur depending on the depth of the objects and camera settings. Hence, these features may represent an important hint for learning to predict depth. In this paper, we propose a full system for single-image depth prediction in the wild using depth-from-defocus and neural networks. We carry out thorough experiments real and simulated defocused images using a realistic model of blur variation with respect to depth. We also investigate the influence of blur on depth prediction observing model uncertainty with a Bayesian neural network approach. From these studies, we show that out-of-focus blur greatly improves the depth-prediction network performances. Furthermore, we transfer the ability learned on a synthetic, indoor dataset to real, indoor and outdoor images. For this purpose, we present a new dataset with real all-focus and defocused images from a DSLR camera, paired with ground truth depth maps obtained with an active 3D sensor for indoor scenes. The proposed approach is successfully validated on both this new dataset and standard ones as NYUv2 or Depth-in-the-Wild. Code and new datasets are available at https://github.com/marcelampc/d3net_depth_estimation.
引用
收藏
页码:307 / 323
页数:17
相关论文
共 33 条