Decoupled and Reparameterized Compound Attention-Based Light Field Depth Estimation Network

被引:3
作者
Liao, Wan [1 ]
Bai, Xiaoqi [2 ]
Zhang, Qian [1 ]
Cao, Jie [1 ]
Fu, Haoyu [1 ]
Wei, Wei [1 ]
Wang, Bin [1 ]
Yan, Tao [3 ]
机构
[1] Shanghai Normal Univ, Coll Informat Mech & Elect Engn, Shanghai 200234, Peoples R China
[2] Educ Inst Yangpu Dist, Shanghai 200092, Peoples R China
[3] Putian Univ, Sch Mech Elect & Informat Engn, Putian 351100, Peoples R China
基金
中国国家自然科学基金;
关键词
Estimation; Feature extraction; Computer architecture; Cameras; Light fields; Spatial resolution; Data mining; Parameter estimation; Light field depth estimation; decoupling; reparameterization; attention mechanism;
D O I
10.1109/ACCESS.2023.3334640
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A light field (LF) camera captures both spatial and angular information of the real world, and the intertwined nature of these dimensions presents a pressing challenge in effectively disentangling meaningful LF information for depth estimation. This paper introduces a feature extraction network based on LF decoupling, which ingeniously separates the LF. Furthermore, given the extensive volume of input data inherent in LF images, a novel reparameterizable Residual-Densely Branched Leaky-ReLU Block(Res-DBLB) architecture was developed to replace conventional residual structures and multibranch architectures and enhance inference efficiency. Incorporating an attention mechanism further refines the network, effectively addressing the computational intensity and time-consuming nature of LF depth estimation, thus furthering the advancement of this technology. Our model was applied to widely used datasets as well as the latest LF datasets, namely HCI and UrbanLF, showing superior performance over six other popular models across four evaluation metrics.
引用
收藏
页码:130119 / 130130
页数:12
相关论文
共 42 条
[1]  
Chen JX, 2021, AAAI CONF ARTIF INTE, V35, P1009
[2]  
Chen L., 2021, IEEE Trans. Vis. Comput. Graphics, V27, P1789
[3]   Fast and Accurate Depth Estimation From Sparse Light Fields [J].
Chuchvara, Aleksandra ;
Barsi, Attila ;
Gotchev, Atanas .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) :2492-2506
[4]   Diverse Branch Block: Building a Convolution as an Inception-like Unit [J].
Ding, Xiaohan ;
Zhang, Xiangyu ;
Han, Jungong ;
Ding, Guiguang .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :10881-10890
[5]   RepVGG: Making VGG-style ConvNets Great Again [J].
Ding, Xiaohan ;
Zhang, Xiangyu ;
Ma, Ningning ;
Han, Jungong ;
Ding, Guiguang ;
Sun, Jian .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :13728-13737
[6]   EPI Light Field Depth Estimation Based on a Directional Relationship Model and Multiviewpoint Attention Mechanism [J].
Gao, Ming ;
Deng, Huiping ;
Xiang, Sen ;
Wu, Jin ;
He, Zeyang .
SENSORS, 2022, 22 (16)
[7]  
Guo C., 2020, PROC IEEE INT C MULT, P1
[8]   Depth Estimation from Light Field Geometry Using Convolutional Neural Networks [J].
Han, Lei ;
Huang, Xiaohua ;
Shi, Zhan ;
Zheng, Shengnan .
SENSORS, 2021, 21 (18)
[9]   Depth from a Light Field Image with Learning-Based Matching Costs [J].
Jeon, Hae-Gon ;
Park, Jaesik ;
Choe, Gyeongmin ;
Park, Jinsun ;
Bok, Yunsu ;
Tai, Yu-Wing ;
Kweon, In So .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (02) :297-310
[10]   Learning to Think Outside the Box: Wide-Baseline Light Field Depth Estimation with EPI-Shift [J].
Leistner, Titus ;
Schilling, Hendrik ;
Mackowiak, Radek ;
Gumhold, Stefan ;
Rother, Carsten .
2019 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2019), 2019, :249-257