Depth estimation using Stereo Light Field Camera

被引:0
作者
Nehra, Suresh [1 ]
Laha, Jayanta [2 ]
Mukhopadhyay, J. [1 ]
Biswas, P. K. [1 ]
机构
[1] Indian Inst Technol Kharagpur, Kharagpur, W Bengal, India
[2] Indian Space Res Org, Bengaluru, India
来源
PROCEEDINGS OF THE THIRTEENTH INDIAN CONFERENCE ON COMPUTER VISION, GRAPHICS, AND IMAGE PROCESSING, ICVGIP 2022 | 2022年
关键词
Light Field Imaging; stereo light field; Lytro Illum; stereo depth estimation; COST AGGREGATION;
D O I
10.1145/3571600.3571624
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Light field imaging has emerged as a new modality, enabling to capture the angular and spatial information of a scene. This additional angular information is used to estimate the depth of a 3-D scene. The continuum of virtual view-points in light field data efficiently handles occlusion and provides a robust depth estimate for smaller distances. However, a narrow baseline in a light field camera limits the depth estimation for larger distances. To have an efficient occlusion handling and increase the operating distances, we proposed a novel disparity based stereo light field depth estimation method. First, segments are obtained in central sub-aperture of left view and then estimate the disparity vector of these segments using left camera sub-aperture images. This handles occlusion efficiently. Then stereo disparity at boundaries of these segments exploiting the epipolar geometry inherent in a light field data. Finally this stereo disparity at boundaries is propagated to other pixels and normalized. We provided a synthetic stereo light field data-set having inherent characteristic of a light field. We have tested our approach on a variety of real-world scenes captured with Lytro Illum camera and also on synthetic images. The proposed method outperforms several state-of-the-art algorithms.
引用
收藏
页数:9
相关论文
共 29 条
[1]  
[Anonymous], 2022, ICVGIP 22
[2]   EPIPOLAR-PLANE IMAGE-ANALYSIS - AN APPROACH TO DETERMINING STRUCTURE FROM MOTION [J].
BOLLES, RC ;
BAKER, HH ;
MARIMONT, DH .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1987, 1 (01) :7-55
[3]  
Gershun A., 1939, Journal of Mathematics and Physics, V18, P51
[4]   Literature Survey on Stereo Vision Disparity Map Algorithms [J].
Hamzah, Rostam Affendi ;
Ibrahim, Haidi .
JOURNAL OF SENSORS, 2016, 2016
[5]   Deep Depth from Focus [J].
Hazirbas, Caner ;
Soyer, Sebastian Georg ;
Staab, Maximilian Christian ;
Leal-Taixe, Laura ;
Cremers, Daniel .
COMPUTER VISION - ACCV 2018, PT III, 2019, 11363 :525-541
[6]   Neural EPI-volume Networks for Shape from Light Field [J].
Heber, Stefan ;
Yu, Wei ;
Pock, Thomas .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2271-2279
[7]   A Dataset and Evaluation Methodology for Depth Estimation on 4D Light Fields [J].
Honauer, Katrin ;
Johannsen, Ole ;
Kondermann, Daniel ;
Goldluecke, Bastian .
COMPUTER VISION - ACCV 2016, PT III, 2017, 10113 :19-34
[8]   Fast Cost-Volume Filtering for Visual Correspondence and Beyond [J].
Hosni, Asmaa ;
Rhemann, Christoph ;
Bleyer, Michael ;
Rother, Carsten ;
Gelautz, Margrit .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (02) :504-511
[9]  
Jeon HG, 2015, PROC CVPR IEEE, P1547, DOI 10.1109/CVPR.2015.7298762
[10]  
Levoy M., 1996, Computer Graphics Proceedings. SIGGRAPH '96, P31, DOI 10.1145/237170.237199