OccCasNet: Occlusion-Aware Cascade Cost Volume for Light Field Depth Estimation

被引:1
|
作者
Chao, Wentao [1 ]
Duan, Fuqing [1 ]
Wang, Xuechun [1 ]
Wang, Yingqian [2 ]
Lu, Ke [3 ]
Wang, Guanghui [4 ]
机构
[1] Beijing Normal Univ, Sch Artificial Intelligence, Beijing 100875, Peoples R China
[2] Natl Univ Def Technol, Coll Elect Sci & Technol, Changsha 410073, Peoples R China
[3] Univ Chinese Acad Sci, Coll Engn Sci, Beijing 100049, Peoples R China
[4] Toronto Metropolitan Univ, Dept Comp Sci, Toronto, ON M5B 2K3, Canada
基金
中国国家自然科学基金;
关键词
Light field; depth estimation; cascade network; occlusion-aware; cost volume; NETWORK;
D O I
10.1109/TCI.2024.3488563
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Depth estimation using the Light Field (LF) technique is an essential task with a wide range of practical applications. While mainstream approaches based on multi-view stereo techniques can attain exceptional accuracy by creating finer cost volumes, they are resource-intensive, time-consuming, and often overlook occlusion during cost volume construction. To address these issues and strike a better balance between accuracy and efficiency, we propose an occlusion-aware cascade cost volume for LF depth (disparity) estimation. Our cascaded strategy reduces the sampling number while maintaining a constant sampling interval, enabling the construction of a finer cost volume. We also introduce occlusion maps to enhance accuracy in constructing the occlusion-aware cost volume. Specifically, we first generate a coarse disparity map through a coarse disparity estimation network. Then, we warp the sub-aperture images (SAIs) of adjacent views to the center view based on the coarse disparity map to generate occlusion maps for each SAI by photo-consistency constraints. Finally, we seamlessly incorporate occlusion maps into cascade cost volume to construct an occlusion-aware refined cost volume, allowing the refined disparity estimation network to yield a more precise disparity map. Extensive experiments demonstrate the effectiveness of our method. Compared with the state-of-the-art techniques, our method achieves a superior balance between accuracy and efficiency, ranking first in the Q25 metric on the HCI 4D benchmark.
引用
收藏
页码:1680 / 1691
页数:12
相关论文
共 50 条
  • [31] Towards Occlusion-Aware Pose Estimation of Surgical Suturing Threads
    Gu, Yun
    Yang, Jie
    Yang, Guang-Zhong
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2023, 70 (02) : 581 - 591
  • [32] Part-Level Occlusion-Aware Human Pose Estimation
    Chu Z.
    Mi Q.
    Ma W.
    Xu S.
    Zhang X.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2022, 59 (12): : 2760 - 2769
  • [33] OCCLUSION-AWARE LAYERED SCENE RECOVERY FROM LIGHT FIELDS
    Lin, Yenting
    Tosic, Ivana
    Berkner, Kathrin
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 295 - 299
  • [34] Occlusion-aware Bi-directional Guided Network for Light Field Salient Object Detection
    Jing, Dong
    Zhang, Shuo
    Cong, Runmin
    Lin, Youfang
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 1692 - 1701
  • [35] Depth estimation of light field based on correction occlusion perception
    Ni, Jing
    Deng, Huiping
    Xiang, Sen
    Wu, Jin
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2024, 39 (09) : 1264 - 1273
  • [36] Enhanced Light Field Depth Estimation for Complex Occlusion Scenes
    Jia, Ying
    Li, Weihai
    TENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2018), 2018, 10806
  • [37] Robust Light Field Depth Estimation for Noisy Scene with Occlusion
    Williem
    Park, In Kyu
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 4396 - 4404
  • [38] Accurate Depth and Normal Maps from Occlusion-Aware Focal Stack Symmetry
    Strecke, Michael
    Alperovich, Anna
    Goldluecke, Bastian
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2529 - 2537
  • [39] Robust, Occlusion-aware Pose Estimation for Objects Grasped by Adaptive Hands
    Wen, Bowen
    Mitash, Chaitanya
    Soorian, Sruthi
    Kimmel, Andrew
    Sintov, Avishai
    Bekris, Kostas E.
    2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 6210 - 6217
  • [40] Torso Orientation: A New Clue for Occlusion-Aware Human Pose Estimation
    Yu, Yang
    Yang, Baoyao
    Yuen, Pong C.
    2016 24TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO), 2016, : 908 - 912