Bidirectional feature learning network for RGB-D salient object detection

被引:1
作者
Niu, Ye
Zhou, Sanping [1 ]
Dong, Yonghao
Wang, Le
Wang, Jinjun
Zheng, Nanning
机构
[1] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian, Peoples R China
基金
国家重点研发计划; 中国博士后科学基金;
关键词
RGB-D salient object detection; Bidirectional feature fusion; Dual consistency loss; IMAGE; FUSION;
D O I
10.1016/j.patcog.2024.110304
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
RGB-D salient object detection aims to perform the pixel-wise localization of salient objects from both RGB and depth images, whose challenge mainly comes from how to learn complementary features from each modality. Existing works often use increasingly large models for performance enhancement, which need large memory and time consumption in practice. In this paper, we propose a simple yet effective Bidirectional Feature Learning Network (BFLNet) for RGB-D salient object detection under limited memory and time conditions. To achieve accurate performance with lightweight backbone networks, an effective Bidirectional Feature Fusion (BFF) module is designed to merge features from both RGB and depth streams, in which the crossmodal fusions and cross-scale fusions are jointly conducted to fuse the immediate features in multiple scales and multiple modals. What is more, a simple Dual Consistency Loss (DCL) function is designed to prompt cross -modal fusion by keeping the consistency between cross -modal target predictions. Extensive experiments on four benchmark datasets demonstrate that our method has achieved the state-of-the-art performance with high efficiency in RGB-D salient object detection. Code will be available at https://github.com/nightskynostar/BFLNet.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] A deep multimodal feature learning network for RGB-D salient object detection
    Liang, Fangfang
    Duan, Lijuan
    Ma, Wei
    Qiao, Yuanhua
    Miao, Jun
    COMPUTERS & ELECTRICAL ENGINEERING, 2021, 92 (92)
  • [2] Circular Complement Network for RGB-D Salient Object Detection
    Bai, Zhen
    Liu, Zhi
    Li, Gongyang
    Ye, Linwei
    Wang, Yang
    NEUROCOMPUTING, 2021, 451 : 95 - 106
  • [3] BGRDNet: RGB-D salient object detection with a bidirectional gated recurrent decoding network
    Liu, Zhengyi
    Wang, Yuan
    Zhang, Zhili
    Tan, Yacheng
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (18) : 25519 - 25539
  • [4] Guided residual network for RGB-D salient object detection with efficient depth feature learning
    Wang, Jian
    Chen, Shuhan
    Lv, Xiao
    Xu, Xiuqi
    Hu, Xuelong
    VISUAL COMPUTER, 2022, 38 (05) : 1803 - 1814
  • [5] Guided residual network for RGB-D salient object detection with efficient depth feature learning
    Jian Wang
    Shuhan Chen
    Xiao Lv
    Xiuqi Xu
    Xuelong Hu
    The Visual Computer, 2022, 38 : 1803 - 1814
  • [6] AirSOD: A Lightweight Network for RGB-D Salient Object Detection
    Zeng, Zhihong
    Liu, Haijun
    Chen, Fenglei
    Tan, Xiaoheng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (03) : 1656 - 1669
  • [7] Siamese Network for RGB-D Salient Object Detection and Beyond
    Fu, Keren
    Fan, Deng-Ping
    Ji, Ge-Peng
    Zhao, Qijun
    Shen, Jianbing
    Zhu, Ce
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) : 5541 - 5559
  • [8] Dynamic Selective Network for RGB-D Salient Object Detection
    Wen, Hongfa
    Yan, Chenggang
    Zhou, Xiaofei
    Cong, Runmin
    Sun, Yaoqi
    Zheng, Bolun
    Zhang, Jiyong
    Bao, Yongjun
    Ding, Guiguang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 9179 - 9192
  • [9] Discriminative feature fusion for RGB-D salient object detection
    Chen, Zeyu
    Zhu, Mingyu
    Chen, Shuhan
    Lu, Lu
    Tang, Haonan
    Hu, Xuelong
    Ji, Chunfan
    COMPUTERS & ELECTRICAL ENGINEERING, 2023, 106
  • [10] RGB-D salient object detection: A survey
    Zhou, Tao
    Fan, Deng-Ping
    Cheng, Ming-Ming
    Shen, Jianbing
    Shao, Ling
    COMPUTATIONAL VISUAL MEDIA, 2021, 7 (01) : 37 - 69