A pooling-based feature pyramid network for salient object detection

被引:8
作者
Shi, Caijuan [1 ]
Zhang, Weiming [1 ]
Duan, Changyu [1 ]
Chen, Houru [1 ]
机构
[1] North China Univ Sci & Technol, Coll Artificial Intelligence, Tangshan 063210, Peoples R China
基金
中国国家自然科学基金;
关键词
Salient object detection; U-shaped feature pyramid; Pooling; Convolutional neural network; Deep feature learning;
D O I
10.1016/j.imavis.2021.104099
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
How to effectively utilize and fuse deep features has become a critical point for salient object detection. Most existing methods usually adopt the convolutional features based on U-shape structures and fuse multi-scale convolutional features without fully considering the different characteristics between high-level features and low-level features. Furthermore, existing salient object detection methods rarely consider the role of pooling in convolutional neural networks. Moreover, there is still much room to improve the detection performance for ob-jects in complex scenes. To address the problems mentioned above, we propose a pooling-based feature pyramid (PFP) network to boost salient object detection performance in this paper. First, we design two U-shaped feature pyramid modules to capture rich semantic information from high-level features and to obtain clear saliency boundaries from low-level features respectively. Second, a pyramid pooling refinement module is designed to utilize the pooling to capture more semantic information. Third, a universal channel-wise attention (UCA) mod-ule is designed to select effective high-level features of multi-scale and multi-receptive -field for rich semantic in-formation, even in complex scenes. Finally, we fuse the selected high-level features and low-level features together, followed by an edge preservation loss to obtain accurate boundary location. Extensive experiments are conducted on five datasets and the experimental results indicate that our proposed method has the ability to get better salient object detection performance compared to the state-of-the-art methods. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 67 条
[1]   Inside-Outside Net: Detecting Objects in Context with Skip Pooling and Recurrent Neural Networks [J].
Bell, Sean ;
Zitnick, C. Lawrence ;
Bala, Kavita ;
Girshick, Ross .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2874-2883
[2]  
Borji A, 2012, 2012 IEEE COMP SOC C, P23, DOI DOI 10.1109/CVPRW.2012.6239191
[3]   Large-Scale Machine Learning with Stochastic Gradient Descent [J].
Bottou, Leon .
COMPSTAT'2010: 19TH INTERNATIONAL CONFERENCE ON COMPUTATIONAL STATISTICS, 2010, :177-186
[4]   A Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detection [J].
Cai, Zhaowei ;
Fan, Quanfu ;
Feris, Rogerio S. ;
Vasconcelos, Nuno .
COMPUTER VISION - ECCV 2016, PT IV, 2016, 9908 :354-370
[5]   Reverse Attention for Salient Object Detection [J].
Chen, Shuhan ;
Tan, Xiuli ;
Wang, Ben ;
Hu, Xuelong .
COMPUTER VISION - ECCV 2018, PT IX, 2018, 11213 :236-252
[6]   Global Contrast Based Salient Region Detection [J].
Cheng, Ming-Ming ;
Mitra, Niloy J. ;
Huang, Xiaolei ;
Torr, Philip H. S. ;
Hu, Shi-Min .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (03) :569-582
[7]   Attentive Feedback Network for Boundary-Aware Salient Object Detection [J].
Feng, Mengyang ;
Lu, Huchuan ;
Ding, Errui .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1623-1632
[8]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149
[9]   3-D Object Retrieval and Recognition With Hypergraph Analysis [J].
Gao, Yue ;
Wang, Meng ;
Tao, Dacheng ;
Ji, Rongrong ;
Dai, Qionghai .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (09) :4290-4303
[10]   Video Saliency Detection Using Object Proposals [J].
Guo, Fang ;
Wang, Wenguan ;
Shen, Jianbing ;
Shao, Ling ;
Yang, Jian ;
Tao, Dacheng ;
Tang, Yuan Yan .
IEEE TRANSACTIONS ON CYBERNETICS, 2018, 48 (11) :3159-3170