CAttNet: A Compound Attention Network for Depth Estimation of Light Field Images

被引:1
作者
Hua, Dingkang [1 ]
Zhang, Qian [1 ]
Liao, Wan [1 ]
Wang, Bin [1 ]
Yan, Tao [2 ]
机构
[1] Shanghai Normal Univ, Sch Informat Mech & Elect Engn, Shanghai, Peoples R China
[2] Putian Univ, Sch Mech Elect & Informat Engn, Putian, Fujian, Peoples R China
来源
JOURNAL OF INFORMATION PROCESSING SYSTEMS | 2023年 / 19卷 / 04期
关键词
Attention Network; Deep Learning; Depth Estimation; Light Field;
D O I
10.3745/JIPS.02.0201
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Depth estimation is one of the most complicated and difficult problems to deal with in the light field. In this paper, a compound attention convolutional neural network (CAttNet) is proposed to extract depth maps from light field images. To make more effective use of the sub-aperture images (SAIs) of light field and reduce the redundancy in SAIs, we use a compound attention mechanism to weigh the channel and space of the feature map after extracting the primary features, so it can more efficiently select the required view and the important area within the view. We modified various layers of feature extraction to make it more efficient and useful to extract features without adding parameters. By exploring the characteristics of light field, we increased the network depth and optimized the network structure to reduce the adverse impact of this change. CAttNet can efficiently utilize different SAIs correlations and features to generate a high-quality light field depth map. The experimental results show that CAttNet has advantages in both accuracy and time.
引用
收藏
页码:483 / 497
页数:15
相关论文
共 24 条
  • [1] Ak A, 2019, EUR W VIS INF PROCES, P135, DOI [10.1109/EUVIP47703.2019.8946194, 10.1109/euvip47703.2019.8946194]
  • [2] Accurate Light Field Depth Estimation With Superpixel Regularization Over Partially Occluded Regions
    Chen, Jie
    Hou, Junhui
    Ni, Yun
    Chau, Lap-Pui
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (10) : 4889 - 4900
  • [3] Image-Based 3D Object Reconstruction: State-of-the-Art and Trends in the Deep Learning Era
    Han, Xian-Feng
    Laga, Hamid
    Bennamoun, Mohammed
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (05) : 1578 - 1604
  • [4] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [5] Heber Stefan, 2014, Computer Vision - ECCV 2014. 13th European Conference. Proceedings: LNCS 8694, P751, DOI 10.1007/978-3-319-10599-4_48
  • [6] A Dataset and Evaluation Methodology for Depth Estimation on 4D Light Fields
    Honauer, Katrin
    Johannsen, Ole
    Kondermann, Daniel
    Goldluecke, Bastian
    [J]. COMPUTER VISION - ACCV 2016, PT III, 2017, 10113 : 19 - 34
  • [7] Klambauer G., 2017, Advances in neural information processing systems, P971
  • [8] Li JK, 2020, INT CONF ACOUST SPEE, P2003, DOI [10.1109/ICASSP40776.2020.9053664, 10.1109/icassp40776.2020.9053664]
  • [9] A Lightweight Depth Estimation Network for Wide-Baseline Light Fields
    Li, Yan
    Wang, Qiong
    Zhang, Lu
    Lafruit, Gauthier
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 2288 - 2300
  • [10] Li Y, 2020, INT CONF ACOUST SPEE, P1998, DOI [10.1109/ICASSP40776.2020.9053532, 10.1109/icassp40776.2020.9053532]