BBS-Net: RGB-D Salient Object Detection with a Bifurcated Backbone Strategy Network

被引:300
作者
Fan, Deng-Ping [1 ]
Zhai, Yingjie [2 ]
Borji, Ali [3 ]
Yang, Jufeng [2 ]
Shao, Ling [1 ,4 ]
机构
[1] Incept Inst Artificial Intelligence, Abu Dhabi, U Arab Emirates
[2] Nankai Univ, Tianjin, Peoples R China
[3] HCL Amer, New York, NY USA
[4] Mohamed Bin Zayed Univ Artificial Intelligence, Abu Dhabi, U Arab Emirates
来源
COMPUTER VISION - ECCV 2020, PT XII | 2020年 / 12357卷
关键词
RGB-D saliency detection; Bifurcated backbone strategy; FUSION;
D O I
10.1007/978-3-030-58610-2_17
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multi-level feature fusion is a fundamental topic in computer vision for detecting, segmenting and classifying objects at various scales. When multi-level features meet multi-modal cues, the optimal fusion problem becomes a hot potato. In this paper, we make the first attempt to leverage the inherent multi-modal and multi-level nature of RGB-D salient object detection to develop a novel cascaded refinement network. In particular, we 1) propose a bifurcated backbone strategy (BBS) to split the multi-level features into teacher and student features, and 2) utilize a depth-enhanced module (DEM) to excavate informative parts of depth cues from the channel and spatial views. This fuses RGB and depth modalities in a complementary way. Our simple yet efficient architecture, dubbed Bifurcated Backbone Strategy Network (BBS-Net), is backbone independent and outperforms 18 SOTAs on seven challenging datasets using four metrics.
引用
收藏
页码:275 / 292
页数:18
相关论文
共 78 条
[71]   Progressive Attention Guided Recurrent Network for Salient Object Detection [J].
Zhang, Xiaoning ;
Wang, Tiantian ;
Qi, Jinqing ;
Lu, Huchuan ;
Wang, Gang .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :714-722
[72]  
Zhang Z, 2020, Arxiv, DOI arXiv:2004.14582
[73]   Gradient-Induced Co-Saliency Detection [J].
Zhang, Zhao ;
Jin, Wenda ;
Xu, Jun ;
Cheng, Ming-Ming .
COMPUTER VISION - ECCV 2020, PT XII, 2020, 12357 :455-472
[74]   Contrast Prior and Fluid Pyramid Integration for RGBD Salient Object Detection [J].
Zhao, Jia-Xing ;
Cao, Yang ;
Fan, Deng-Ping ;
Cheng, Ming-Ming ;
Li, Xuan-Yi ;
Zhang, Le .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3922-3931
[75]   EGNet: Edge Guidance Network for Salient Object Detection [J].
Zhao, Jia-Xing ;
Liu, Jiang-Jiang ;
Fan, Deng-Ping ;
Cao, Yang ;
Yang, Ju-Feng ;
Cheng, Ming-Ming .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :8778-8787
[76]   PDNET: PRIOR-MODEL GUIDED DEPTH-ENHANCED NETWORK FOR SALIENT OBJECT DETECTION [J].
Zhu, Chunbiao ;
Cai, Xing ;
Huang, Kan ;
Li, Thomas H. ;
Li, Ge .
2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, :199-204
[77]   An Innovative Salient Object Detection Using Center-Dark Channel Prior [J].
Zhu, Chunbiao ;
Li, Ge ;
Wang, Wenmin ;
Wang, Ronggang .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, :1509-1515
[78]   A Three-pathway Psychobiological Framework of Salient Object Detection Using Stereoscopic Technology [J].
Zhu, Chunbiao ;
Li, Ge .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, :3008-3014