C2DFNet: Criss-Cross Dynamic Filter Network for RGB-D Salient Object Detection

被引:50
作者
Zhang, Miao [1 ]
Yao, Shunyu [2 ]
Hu, Beiqi [2 ]
Piao, Yongri [3 ]
Ji, Wei [4 ]
机构
[1] Dalian Univ Technol, DUT RU Int Sch Informat Sci & Software Engn, Key Lab Ubiquitous Network & Serv Software Liaonin, Dalian 116024, Peoples R China
[2] Dalian Univ Technol, Sch Software Technol, Dalian 116024, Peoples R China
[3] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian 116024, Peoples R China
[4] Univ Alberta, Dept Elect & Comp Engn, Edmonton, AB T6G 2R3, Canada
基金
中国国家自然科学基金;
关键词
Dynamic filter; fusion network; RGB-D salient object detection;
D O I
10.1109/TMM.2022.3187856
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The ability to deal with intra and inter-modality features has been critical to the development of RGB-D salient object detection. While many works have advanced in leaps and bounds in this field, most existing methods have not taken their way down into the inherent differences between the RGB and depth data due to widely adopted conventional convolution in which fixed parameter kernels are applied during inference. To promote intra and inter-modality interaction conditioned on various scenarios, as RGB and depth data are processed independently and later fused interactively, we develop a new insight and a better model. In this paper, we introduce a criss-cross dynamic filter network by decoupling dynamic convolution. First, we propose a Model-specific Dynamic Enhanced Module (MDEM) that dynamically enhances the intra-modality features with global context guidance. Second, we propose a Scene-aware Dynamic Fusion Module (SDFM) to realize dynamic feature selection between two modalities. As a result, our model achieves accurate predictions of salient objects. Extensive experiments demonstrate that our method achieves competitive performance over 28 state-of-the-art RGB-D methods on 7 public datasets.
引用
收藏
页码:5142 / 5154
页数:13
相关论文
共 50 条
  • [21] LIANet: Layer Interactive Attention Network for RGB-D Salient Object Detection
    Han, Yibo
    Wang, Liejun
    Du, Anyu
    Jiang, Shaochen
    IEEE ACCESS, 2022, 10 : 25435 - 25447
  • [22] SPSN: Superpixel Prototype Sampling Network for RGB-D Salient Object Detection
    Lee, Minhyeok
    Park, Chaewon
    Cho, Suhwan
    Lee, Sangyoun
    COMPUTER VISION, ECCV 2022, PT XXIX, 2022, 13689 : 630 - 647
  • [23] Perceptual localization and focus refinement network for RGB-D salient object detection
    Han, Jinyu
    Wang, Mengyin
    Wu, Weiyi
    Jia, Xu
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 259
  • [24] Scenario potentiality-constrain network for RGB-D salient object detection
    Zong, Guanyu
    Li, Xu
    Xu, Qimin
    KNOWLEDGE-BASED SYSTEMS, 2025, 310
  • [25] Depth cue enhancement and guidance network for RGB-D salient object detection
    Li, Xiang
    Zhang, Qing
    Yan, Weiqi
    Dai, Meng
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 95
  • [26] Depth-aware lightweight network for RGB-D salient object detection
    Ling, Liuyi
    Wang, Yiwen
    Wang, Chengjun
    Xu, Shanyong
    Huang, Yourui
    IET IMAGE PROCESSING, 2023, 17 (08) : 2350 - 2361
  • [27] Disentangled Cross-Modal Transformer for RGB-D Salient Object Detection and Beyond
    Chen, Hao
    Shen, Feihong
    Ding, Ding
    Deng, Yongjian
    Li, Chao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 1699 - 1709
  • [28] MobileSal: Extremely Efficient RGB-D Salient Object Detection
    Wu, Yu-Huan
    Liu, Yun
    Xu, Jun
    Bian, Jia-Wang
    Gu, Yu-Chao
    Cheng, Ming-Ming
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (12) : 10261 - 10269
  • [29] Discriminative feature fusion for RGB-D salient object detection
    Chen, Zeyu
    Zhu, Mingyu
    Chen, Shuhan
    Lu, Lu
    Tang, Haonan
    Hu, Xuelong
    Ji, Chunfan
    COMPUTERS & ELECTRICAL ENGINEERING, 2023, 106
  • [30] Bifurcated Backbone Strategy for RGB-D Salient Object Detection
    Zhai, Yingjie
    Fan, Deng-Ping
    Yang, Jufeng
    Borji, Ali
    Shao, Ling
    Han, Junwei
    Wang, Liang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 8727 - 8742