D2Net: discriminative feature extraction and details preservation network for salient object detection

被引:0
作者
Guo, Qianqian [1 ]
Shi, Yanjiao [1 ]
Zhang, Jin [1 ]
Yang, Jinyu [1 ]
Zhang, Qing [1 ]
机构
[1] Shanghai Inst Technol, Sch Comp Sci & Informat Engn, Shanghai, Peoples R China
基金
上海市自然科学基金; 中国国家自然科学基金;
关键词
salient object detection; convolutional neural network; multi-scale features; feature fusion; MODEL;
D O I
10.1117/1.JEI.33.4.043047
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Convolutional neural networks (CNNs) with a powerful feature extraction ability have raised the performance of salient object detection (SOD) to a unique level, and how to effectively decode the rich features from CNN is the key to improving the performance of the SOD model. Some previous works ignored the differences between the high-level and low-level features and neglected the information loss during feature processing, making them fail in some challenging scenes. To solve this problem, we propose a discriminative feature extraction and details preservation network (D(2)Net) for SOD. According to the different characteristics of high-level and low-level features, we design a residual optimization module for filtering complex background noise in shallow features and a pyramid feature extraction module to eliminate the information loss caused by atrous convolution in high-level features. Furthermore, we design a features aggregation module to aggregate the elaborately processed high-level and low-level features, which fully considers the performance of different level features and preserves the delicate boundary of salient object. The comparisons with 17 existing state-of-the-art SOD methods on five popular datasets demonstrate the superiority of the proposed D(2)Net, and the effectiveness of each proposed module is verified through numerous ablation experiments. (c) 2024 SPIE and IS&T
引用
收藏
页数:20
相关论文
共 72 条
[51]   IMSFNet: integrated multi-source feature network for salient object detection [J].
Xia, Chenxing ;
Sun, Yanguang ;
Fang, Xianjin ;
Ge, Bin ;
Gao, Xiuju ;
Li, Kuan-Ching .
APPLIED INTELLIGENCE, 2023, 53 (19) :22228-22248
[52]   Hierarchical Saliency Detection [J].
Yan, Qiong ;
Xu, Li ;
Shi, Jianping ;
Jia, Jiaya .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :1155-1162
[53]   Saliency Detection via Graph-Based Manifold Ranking [J].
Yang, Chuan ;
Zhang, Lihe ;
Lu, Huchuan ;
Ruan, Xiang ;
Yang, Ming-Hsuan .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :3166-3173
[54]   Progressive Self-Guided Loss for Salient Object Detection [J].
Yang, Sheng ;
Lin, Weisi ;
Lin, Guosheng ;
Jiang, Qiuping ;
Liu, Zichuan .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :8426-8438
[55]   Towards High-Resolution Salient Object Detection [J].
Zeng, Yi ;
Zhang, Pingping ;
Zhang, Jianming ;
Lin, Zhe ;
Lu, Huchuan .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :7233-7242
[56]   Saliency-Guided Unsupervised Feature Learning for Scene Classification [J].
Zhang, Fan ;
Du, Bo ;
Zhang, Liangpei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (04) :2175-2184
[57]   R2Net: Residual refinement network for salient object detection [J].
Zhang, Jin ;
Liang, Qiuwei ;
Guo, Qianqian ;
Yang, Jinyu ;
Zhang, Qing ;
Shi, Yanjiao .
IMAGE AND VISION COMPUTING, 2022, 120
[58]  
Zhang Jing, 2021, P ANN C NEUR INF PRO, P15448
[59]  
Zhang JX, 2014, IEEE IMAGE PROC, P1175, DOI 10.1109/ICIP.2014.7025234
[60]   Salient Object Detection With Edge-Guided Learning and Specific Aggregation [J].
Zhang, Liqian ;
Zhang, Qing .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (01) :534-548