OccCasNet: Occlusion-Aware Cascade Cost Volume for Light Field Depth Estimation

被引:1
|
作者
Chao, Wentao [1 ]
Duan, Fuqing [1 ]
Wang, Xuechun [1 ]
Wang, Yingqian [2 ]
Lu, Ke [3 ]
Wang, Guanghui [4 ]
机构
[1] Beijing Normal Univ, Sch Artificial Intelligence, Beijing 100875, Peoples R China
[2] Natl Univ Def Technol, Coll Elect Sci & Technol, Changsha 410073, Peoples R China
[3] Univ Chinese Acad Sci, Coll Engn Sci, Beijing 100049, Peoples R China
[4] Toronto Metropolitan Univ, Dept Comp Sci, Toronto, ON M5B 2K3, Canada
基金
中国国家自然科学基金;
关键词
Light field; depth estimation; cascade network; occlusion-aware; cost volume; NETWORK;
D O I
10.1109/TCI.2024.3488563
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Depth estimation using the Light Field (LF) technique is an essential task with a wide range of practical applications. While mainstream approaches based on multi-view stereo techniques can attain exceptional accuracy by creating finer cost volumes, they are resource-intensive, time-consuming, and often overlook occlusion during cost volume construction. To address these issues and strike a better balance between accuracy and efficiency, we propose an occlusion-aware cascade cost volume for LF depth (disparity) estimation. Our cascaded strategy reduces the sampling number while maintaining a constant sampling interval, enabling the construction of a finer cost volume. We also introduce occlusion maps to enhance accuracy in constructing the occlusion-aware cost volume. Specifically, we first generate a coarse disparity map through a coarse disparity estimation network. Then, we warp the sub-aperture images (SAIs) of adjacent views to the center view based on the coarse disparity map to generate occlusion maps for each SAI by photo-consistency constraints. Finally, we seamlessly incorporate occlusion maps into cascade cost volume to construct an occlusion-aware refined cost volume, allowing the refined disparity estimation network to yield a more precise disparity map. Extensive experiments demonstrate the effectiveness of our method. Compared with the state-of-the-art techniques, our method achieves a superior balance between accuracy and efficiency, ranking first in the Q25 metric on the HCI 4D benchmark.
引用
收藏
页码:1680 / 1691
页数:12
相关论文
共 50 条
  • [41] CONet: Crowd and occlusion-aware network for occluded human pose estimation
    Bai, Xiuxiu
    Wei, Xing
    Wang, Zengying
    Zhang, Miao
    NEURAL NETWORKS, 2024, 172
  • [42] Cost aggregation benchmark for light field depth estimation
    Williem
    Park, In Kyu
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 56 : 38 - 51
  • [43] Robust Local Light Field Synthesis via Occlusion-aware Sampling and Deep Visual Feature Fusion
    Wenpeng Xing
    Jie Chen
    Yike Guo
    Machine Intelligence Research, 2023, 20 : 408 - 420
  • [44] Robust Local Light Field Synthesis via Occlusion-aware Sampling and Deep Visual Feature Fusion
    Xing, Wenpeng
    Chen, Jie
    Guo, Yike
    MACHINE INTELLIGENCE RESEARCH, 2023, 20 (03) : 408 - 420
  • [45] Pedestrian Emergence Estimation and Occlusion-Aware Risk Assessment for Urban Autonomous Driving
    Koc, Mert
    Yurtsever, Ekim
    Redmill, Keith
    Ozguner, Umit
    2021 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2021, : 292 - 297
  • [46] Towards Precise Pose Estimation in Robotic Surgery: Introducing Occlusion-Aware Loss
    Park, Jihun
    Hong, Jiuk
    Yoon, Jihun
    Park, Bokyung
    Choi, Min-Kook
    Jung, Heechul
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT VI, 2024, 15006 : 639 - 648
  • [47] Occlusion-Aware Networks for 3D Human Pose Estimation in Video
    Cheng, Yu
    Yang, Bo
    Wang, Bo
    Yan, Wending
    Tan, Robby T.
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 723 - 732
  • [48] A METHOD FOR HANDLING MULTI-OCCLUSION IN DEPTH ESTIMATION OF LIGHT FIELD
    Pan, Xihao
    Zhang, Tao
    Wang, Hao
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 1069 - 1073
  • [49] Occlusion-Model Guided Antiocclusion Depth Estimation in Light Field
    Zhu, Hao
    Wang, Qing
    Yu, Jingyi
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2017, 11 (07) : 965 - 978
  • [50] Depth Estimation Method of Light Field Image Based on Occlusion Scene
    Liu Xiaomin
    Du Mengzhu
    Ma Zhibang
    Zhu Yunfei
    Chen Pengbo
    Ma Fengying
    ACTA OPTICA SINICA, 2020, 40 (05)