Depth estimation of light field based on correction occlusion perception

被引:0
作者
Ni, Jing [1 ]
Deng, Huiping [1 ]
Xiang, Sen [1 ]
Wu, Jin [1 ]
机构
[1] Wuhan Univ Sci & Technol, Sch Informat Sci & Engn, Wuhan 430081, Peoples R China
基金
中国国家自然科学基金;
关键词
light field; depth estimation; occlusion mask; correction convolution; spatial attention;
D O I
10.37188/CJLCD.2023-0307
中图分类号
O7 [晶体学];
学科分类号
0702 ; 070205 ; 0703 ; 080501 ;
摘要
The light field image can record the light information of different position and direction in space simultaneously, , which provides rich information for estimating accurate depth map. However, , in complex scenes such as occlusion and repeated texture, , the lack of feature extraction will lead to the loss of detail in depth map. An optical field depth estimation network based on correction convolution is proposed to make full use of the rich structural information for optical field images to improve the depth estimation of complex areas such as occlusion. The occlusion mask is generated by using the initial disparity map and subaperture image, , and the spatial information of the occlusion area is perceived by correcting convolutional discrimination and encoding, , and multi-scale features are combined to supplement the edge details that are easily lost. The spatial attention mechanism is used to give more weight to the occlusion area, , eliminate redundant information and optimize the subpixel cost body globally. Experimental results show that average MSE and BadPix ( epsilon =0. 03) ) of the proposed method on 4D optical field reference platform are 0.951 and 4.261, , respectively. The proposed method can achieve depth estimation with minimum error in most scenes, , and shows high robustness to the occlusion area, , which is better than other algorithms.
引用
收藏
页码:1264 / 1273
页数:10
相关论文
共 22 条
[1]  
Ba J, 2014, ACS SYM SER
[2]   Novel DPSK Demodulation System and Its Performance [J].
Qi Y. ;
Wang Y. ;
Zhu Y. ;
Yang Z. ;
Li T. ;
Jin Z. .
Guangxue Xuebao/Acta Optica Sinica, 2023, 43 (05)
[3]  
Chen JX, 2021, AAAI CONF ARTIF INTE, V35, P1009
[4]   Group-wise Correlation Stereo Network [J].
Guo, Xiaoyang ;
Yang, Kai ;
Yang, Wukui ;
Wang, Xiaogang ;
Li, Hongsheng .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3268-3277
[5]   Neural EPI-volume Networks for Shape from Light Field [J].
Heber, Stefan ;
Yu, Wei ;
Pock, Thomas .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2271-2279
[6]   Convolutional Networks for Shape from Light Field [J].
Heber, Stefan ;
Pock, Thomas .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :3746-3754
[7]   A Dataset and Evaluation Methodology for Depth Estimation on 4D Light Fields [J].
Honauer, Katrin ;
Johannsen, Ole ;
Kondermann, Daniel ;
Goldluecke, Bastian .
COMPUTER VISION - ACCV 2016, PT III, 2017, 10113 :19-34
[8]  
Jeon HG, 2015, PROC CVPR IEEE, P1547, DOI 10.1109/CVPR.2015.7298762
[9]   Improving Convolutional Networks with Self-Calibrated Convolutions [J].
Liu, Jiang-Jiang ;
Hou, Qibin ;
Cheng, Ming-Ming ;
Wang, Changhu ;
Feng, Jiashi .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :10093-10102
[10]   DGE-CNN: 2D-to-3D holographic display based on a depth gradient extracting module and ZCNN network [J].
Liu, Ninghe ;
Huang, Zhengzhong ;
He, Zehao ;
Cao, Liangcai .
OPTICS EXPRESS, 2023, 31 (15) :23867-23876