Single Image Depth Estimation Using Edge Extraction Network and Dark Channel Prior

被引:3
作者
Li, Ying [1 ]
Jung, Cheolkon [1 ]
Kim, Jinyoung [2 ]
机构
[1] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
[2] Chonnam Natl Univ, Dept ICT Convergence Syst Engn, Gwangju 61186, South Korea
基金
中国国家自然科学基金;
关键词
Image edge detection; Estimation; Generators; Generative adversarial networks; Image color analysis; Deep learning; Channel estimation; Depth estimation; dark channel prior; deep learning; edge extraction; generative adversarial network; transmission; SEGMENTATION;
D O I
10.1109/ACCESS.2021.3100037
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The key to the depth estimation from a single image lies in inferring the distance of various objects without copying texture while maintaining clear object boundaries. In this paper, we propose depth estimation from a single image using edge extraction network and dark channel prior (DCP). We build an edge extraction network based on generative adversarial networks (GANs) to select valid depth edges from a number of edges in an image. We use DCP to generate a transmission map that is able to represent distance from the camera. Transmission map is generated by conducting minimum value filtering on DCP. First, we concatenate the transmission map with the original RGB image to form a tensor, i.e. RGB + T. Second, we generate an initial depth image from the tensor through the generator by inferring depth from stacked residual blocks. Third, we compare the edge map of the initial depth image with that of the input RGB image to select valid depth edges. Both edge maps are generated by the edge extraction network. Finally, we distinguish real and fake on the generated depth image using a discriminator, and enhances the performance of the generator. Various experiments on NYU, Make3D and MPI Sintel datasets demonstrate that the proposed network generates clear edges in depth images as well as outperforms state-of-the-art methods in terms of visual quality and quantitative measurements.
引用
收藏
页码:112454 / 112465
页数:12
相关论文
共 50 条
  • [1] [Anonymous], 2005, Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
  • [2] Bazazian D., 2015, P INT C DIG IM COMP, P1
  • [3] Discrete Laplace Operator on Meshed Surfaces
    Belkin, Mikhail
    Sun, Jian
    Wang, Yusu
    [J]. PROCEEDINGS OF THE TWENTY-FOURTH ANNUAL SYMPOSIUM ON COMPUTATIONAL GEOMETRY (SGG'08), 2008, : 278 - 287
  • [4] A Naturalistic Open Source Movie for Optical Flow Evaluation
    Butler, Daniel J.
    Wulff, Jonas
    Stanley, Garrett B.
    Black, Michael J.
    [J]. COMPUTER VISION - ECCV 2012, PT VI, 2012, 7577 : 611 - 625
  • [5] Variational Fusion of Time-of-Flight and Stereo Data for Depth Estimation Using Edge-Selective Joint Filtering
    Chen, Baoliang
    Jung, Cheolkon
    Zhang, Zhendong
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (11) : 2882 - 2890
  • [6] Dubayah RO, 2000, J FOREST, V98, P44
  • [7] Eigen D, 2014, ADV NEUR IN, V27
  • [8] Automatic image segmentation by integrating color-edge extraction and seeded region growing
    Fan, JP
    Yau, DKY
    Elmagarmid, AK
    Aref, WG
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2001, 10 (10) : 1454 - 1466
  • [9] Deep Ordinal Regression Network for Monocular Depth Estimation
    Fu, Huan
    Gong, Mingming
    Wang, Chaohui
    Batmanghelich, Kayhan
    Tao, Dacheng
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 2002 - 2011
  • [10] Image Style Transfer Using Convolutional Neural Networks
    Gatys, Leon A.
    Ecker, Alexander S.
    Bethge, Matthias
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 2414 - 2423