CAttNet: A Compound Attention Network for Depth Estimation of Light Field Images

被引:2
作者
Hua, Dingkang [1 ]
Zhang, Qian [1 ]
Liao, Wan [1 ]
Wang, Bin [1 ]
Yan, Tao [2 ]
机构
[1] Shanghai Normal Univ, Sch Informat Mech & Elect Engn, Shanghai, Peoples R China
[2] Putian Univ, Sch Mech Elect & Informat Engn, Putian, Fujian, Peoples R China
来源
JOURNAL OF INFORMATION PROCESSING SYSTEMS | 2023年 / 19卷 / 04期
关键词
Attention Network; Deep Learning; Depth Estimation; Light Field;
D O I
10.3745/JIPS.02.0201
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Depth estimation is one of the most complicated and difficult problems to deal with in the light field. In this paper, a compound attention convolutional neural network (CAttNet) is proposed to extract depth maps from light field images. To make more effective use of the sub-aperture images (SAIs) of light field and reduce the redundancy in SAIs, we use a compound attention mechanism to weigh the channel and space of the feature map after extracting the primary features, so it can more efficiently select the required view and the important area within the view. We modified various layers of feature extraction to make it more efficient and useful to extract features without adding parameters. By exploring the characteristics of light field, we increased the network depth and optimized the network structure to reduce the adverse impact of this change. CAttNet can efficiently utilize different SAIs correlations and features to generate a high-quality light field depth map. The experimental results show that CAttNet has advantages in both accuracy and time.
引用
收藏
页码:483 / 497
页数:15
相关论文
共 24 条
[1]  
Ak A, 2019, EUR W VIS INF PROCES, P135, DOI [10.1109/euvip47703.2019.8946194, 10.1109/EUVIP47703.2019.8946194]
[2]   Accurate Light Field Depth Estimation With Superpixel Regularization Over Partially Occluded Regions [J].
Chen, Jie ;
Hou, Junhui ;
Ni, Yun ;
Chau, Lap-Pui .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (10) :4889-4900
[3]   Image-Based 3D Object Reconstruction: State-of-the-Art and Trends in the Deep Learning Era [J].
Han, Xian-Feng ;
Laga, Hamid ;
Bennamoun, Mohammed .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (05) :1578-1604
[4]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[5]  
Heber Stefan, 2014, Computer Vision - ECCV 2014. 13th European Conference. Proceedings: LNCS 8694, P751, DOI 10.1007/978-3-319-10599-4_48
[6]   A Dataset and Evaluation Methodology for Depth Estimation on 4D Light Fields [J].
Honauer, Katrin ;
Johannsen, Ole ;
Kondermann, Daniel ;
Goldluecke, Bastian .
COMPUTER VISION - ACCV 2016, PT III, 2017, 10113 :19-34
[7]  
Klambauer G, 2017, ADV NEUR IN, V30
[8]  
Li JK, 2020, INT CONF ACOUST SPEE, P2003, DOI [10.1109/icassp40776.2020.9053664, 10.1109/ICASSP40776.2020.9053664]
[9]   A Lightweight Depth Estimation Network for Wide-Baseline Light Fields [J].
Li, Yan ;
Wang, Qiong ;
Zhang, Lu ;
Lafruit, Gauthier .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :2288-2300
[10]  
Li Y, 2020, INT CONF ACOUST SPEE, P1998, DOI [10.1109/ICASSP40776.2020.9053532, 10.1109/icassp40776.2020.9053532]