Bidirectional feature learning network for RGB-D salient object detection

被引:1
作者
Niu, Ye
Zhou, Sanping [1 ]
Dong, Yonghao
Wang, Le
Wang, Jinjun
Zheng, Nanning
机构
[1] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian, Peoples R China
基金
国家重点研发计划; 中国博士后科学基金;
关键词
RGB-D salient object detection; Bidirectional feature fusion; Dual consistency loss; IMAGE; FUSION;
D O I
10.1016/j.patcog.2024.110304
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
RGB-D salient object detection aims to perform the pixel-wise localization of salient objects from both RGB and depth images, whose challenge mainly comes from how to learn complementary features from each modality. Existing works often use increasingly large models for performance enhancement, which need large memory and time consumption in practice. In this paper, we propose a simple yet effective Bidirectional Feature Learning Network (BFLNet) for RGB-D salient object detection under limited memory and time conditions. To achieve accurate performance with lightweight backbone networks, an effective Bidirectional Feature Fusion (BFF) module is designed to merge features from both RGB and depth streams, in which the crossmodal fusions and cross-scale fusions are jointly conducted to fuse the immediate features in multiple scales and multiple modals. What is more, a simple Dual Consistency Loss (DCL) function is designed to prompt cross -modal fusion by keeping the consistency between cross -modal target predictions. Extensive experiments on four benchmark datasets demonstrate that our method has achieved the state-of-the-art performance with high efficiency in RGB-D salient object detection. Code will be available at https://github.com/nightskynostar/BFLNet.
引用
收藏
页数:9
相关论文
共 50 条
  • [31] Context-aware network for RGB-D salient object detection
    Liang, Fangfang
    Duan, Lijuan
    Ma, Wei
    Qiao, Yuanhua
    Miao, Jun
    Ye, Qixiang
    PATTERN RECOGNITION, 2021, 111
  • [32] Asymmetric deep interaction network for RGB-D salient object detection
    Wang, Feifei
    Li, Yongming
    Wang, Liejun
    Zheng, Panpan
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 266
  • [33] An adaptive guidance fusion network for RGB-D salient object detection
    Haodong Sun
    Yu Wang
    Xinpeng Ma
    Signal, Image and Video Processing, 2024, 18 : 1683 - 1693
  • [34] Scale Adaptive Fusion Network for RGB-D Salient Object Detection
    Kong, Yuqiu
    Zheng, Yushuo
    Yao, Cuili
    Liu, Yang
    Wang, He
    COMPUTER VISION - ACCV 2022, PT III, 2023, 13843 : 608 - 625
  • [35] An adaptive guidance fusion network for RGB-D salient object detection
    Sun, Haodong
    Wang, Yu
    Ma, Xinpeng
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (02) : 1683 - 1693
  • [36] Discriminative unimodal feature selection and fusion for RGB-D salient object detection
    Huang, Nianchang
    Luo, Yongjiang
    Zhang, Qiang
    Han, Jungong
    PATTERN RECOGNITION, 2022, 122
  • [37] DMNet: Dynamic Memory Network for RGB-D Salient Object Detection
    Du, Haishun
    Zhang, Zhen
    Zhang, Minghao
    Qiao, Kangyi
    DIGITAL SIGNAL PROCESSING, 2023, 142
  • [38] CFIDNet: cascaded feature interaction decoder for RGB-D salient object detection
    Chen, Tianyou
    Hu, Xiaoguang
    Xiao, Jin
    Zhang, Guofeng
    Wang, Shaojie
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (10) : 7547 - 7563
  • [39] MobileSal: Extremely Efficient RGB-D Salient Object Detection
    Wu, Yu-Huan
    Liu, Yun
    Xu, Jun
    Bian, Jia-Wang
    Gu, Yu-Chao
    Cheng, Ming-Ming
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (12) : 10261 - 10269
  • [40] Bi-Directional Progressive Guidance Network for RGB-D Salient Object Detection
    Yang, Yang
    Qin, Qi
    Luo, Yongjiang
    Liu, Yi
    Zhang, Qiang
    Han, Jungong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (08) : 5346 - 5360