Light-field-depth-estimation network based on epipolar geometry and image segmentation

被引:14
作者
Wang, Xucheng [1 ]
Tao, Chenning [1 ]
Wu, Rengmao [1 ]
Tao, Xiao [1 ]
Sun, Peng [1 ]
Li, Yong [1 ,2 ]
Zheng, Zhenrong [1 ]
机构
[1] Zhejiang Univ, Coll Opt Sci & Engn, State Key Lab Modern Opt Instrumentat, Hangzhou 310027, Peoples R China
[2] Beiing LLVis Technol Co Ltd, Beijing 100000, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1364/JOSAA.388555
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
In this paper, we propose a convolutional neural network based on epipolar geometry and image segmentation for light-field depth estimation. Epipolar geometry is utilized to estimate the initial disparity map. Multi-orientation epipolar images are selected as input data, and the convolutional blocks are adopted based on the disparity of different-direction epipolar images. Image segmentation is used to obtain the edge information of the central sub-aperture image. By concatenating the output of the two parts, an accurate depth map could be generated with fast speed. Our method achieves a high rank on most quality assessment metrics in the HCI 4D Light Field Benchmark and also shows effectiveness in estimating accurate depth on real-world light-field images. (C) 2020 Optical Society of America
引用
收藏
页码:1236 / 1243
页数:8
相关论文
共 30 条
  • [1] Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
  • [2] [Anonymous], 2005, Comput. Sci. Tech. Rep.
  • [3] [Anonymous], 2015, PROC CVPR IEEE
  • [4] [Anonymous], IRISA LYTRO ILLUM LI
  • [5] [Anonymous], 4D LIGHT FIELD BENCH
  • [6] EPIPOLAR-PLANE IMAGE-ANALYSIS - AN APPROACH TO DETERMINING STRUCTURE FROM MOTION
    BOLLES, RC
    BAKER, HH
    MARIMONT, DH
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 1987, 1 (01) : 7 - 55
  • [7] Robust Principal Component Analysis?
    Candes, Emmanuel J.
    Li, Xiaodong
    Ma, Yi
    Wright, John
    [J]. JOURNAL OF THE ACM, 2011, 58 (03)
  • [8] Light Field Stereo Matching Using Bilateral Statistics of Surface Cameras
    Chen, Can
    Lin, Haiting
    Yu, Zhan
    Kang, Sing Bing
    Yu, Jingyi
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 1518 - 1525
  • [9] Heterogeneous Light Fields
    Diebold, Maximilian
    Jaehne, Bernd
    Gatto, Alexander
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 1745 - 1753
  • [10] Heber Stefan, 2014, Computer Vision - ECCV 2014. 13th European Conference. Proceedings: LNCS 8694, P751, DOI 10.1007/978-3-319-10599-4_48