Progressively Guided Alternate Refinement Network for RGB-D Salient Object Detection

被引:108
作者
Chen, Shuhan [1 ]
Fu, Yun [2 ,3 ]
机构
[1] Yangzhou Univ, Sch Informat Engn, Yangzhou, Peoples R China
[2] Northeastern Univ, Dept ECE, Boston, MA USA
[3] Northeastern Univ, Khoury Coll Comp Sci, Boston, MA USA
来源
COMPUTER VISION - ECCV 2020, PT VIII | 2020年 / 12353卷
关键词
RGB-D salient object detection; Lightweight depth stream; Alternate refinement; Progressive guidance; FUSION;
D O I
10.1007/978-3-030-58598-3_31
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we aim to develop an efficient and compact deep network for RGB-D salient object detection, where the depth image provides complementary information to boost performance in complex scenarios. Starting from a coarse initial prediction by a multi-scale residual block, we propose a progressively guided alternate refinement network to refine it. Instead of using ImageNet pre-trained backbone network, we first construct a lightweight depth stream by learning from scratch, which can extract complementary features more efficiently with less redundancy. Then, different from the existing fusion based methods, RGB and depth features are fed into proposed guided residual (GR) blocks alternately to reduce their mutual degradation. By assigning progressive guidance in the stacked GR blocks within each side-output, the false detection and missing parts can be well remedied. Extensive experiments on seven benchmark datasets demonstrate that our model outperforms existing state-of-the-art approaches by a large margin, and also shows superiority in efficiency (71 FPS) and model size (64.9 MB).
引用
收藏
页码:520 / 538
页数:19
相关论文
共 63 条
[1]   Three-Stream Attention-Aware Network for RGB-D Salient Object Detection [J].
Chen, Hao ;
Li, Youfu .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (06) :2825-2835
[2]   Progressively Complementarity-aware Fusion Network for RGB-D Salient Object Detection [J].
Chen, Hao ;
Li, Youfu .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3051-3060
[3]   Multi-modal fusion network with multi-scale multi-path and cross-modal interactions for RGB-D salient object detection [J].
Chen, Hao ;
Li, Youfu ;
Su, Dan .
PATTERN RECOGNITION, 2019, 86 :376-385
[4]   Reverse Attention for Salient Object Detection [J].
Chen, Shuhan ;
Tan, Xiuli ;
Wang, Ben ;
Hu, Xuelong .
COMPUTER VISION - ECCV 2018, PT IX, 2018, 11213 :236-252
[5]   Reverse Attention-Based Residual Network for Salient Object Detection [J].
Chen, Shuhan ;
Tan, Xiuli ;
Wang, Ben ;
Lu, Huchuan ;
Hu, Xuelong ;
Fu, Yun .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :3763-3776
[6]   Embedding Attention and Residual Network for Accurate Salient Object Detection [J].
Chen, Shuhan ;
Wang, Ben ;
Tan, Xiuli ;
Hu, Xuelong .
IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (05) :2050-2062
[7]   Discriminative saliency propagation with sink points [J].
Chen, Shuhan ;
Zheng, Ling ;
Hu, Xuelong ;
Zhou, Ping .
PATTERN RECOGNITION, 2016, 60 :2-12
[8]  
Cheng Y, 2014, IEEE INT CON MULTI
[9]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[10]  
Deng ZJ, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P684