Selective feature fusion network for salient object detection

被引:2
作者
Sun, Fengming [1 ]
Yuan, Xia [1 ]
Zhao, Chunxia [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Dept Pattern Recognit & Intelligent Syst, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
attention mechanism; feature fusion; multi-level feature; salient object detection;
D O I
10.1049/cvi2.12183
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Fully convolutional neural networks have achieved great success in salient object detection, in which the effective use of multi-layer features plays a critical role. Based on this advantage, many saliency detectors have emerged in recent years, and most of them designed a series of network structures to integrate the multi-level features generated by the backbone network. However, information in different layer play different roles in saliency object detection, how to integrate them effectively is still a great challenge. In this article, a selective feature fusion network which consists of a selective feature fusion module (SFM) and an attention-guide hierarchical feature emphasis module (AEM) is proposed. Most of the previous works mainly integrate multi-level feature by addition and concatenation, as a difference, SFM adaptively selects the important information from the input features in the fusion, which effectively avoids introducing too much redundant information. Besides, AEM combines spatial attention and channel attention to enhance features simply and effectively by hierarchical iteration, and further improve the accuracy of salient object detection. Experiments on five datasets show that the proposed selective feature fusion method achieve satisfactory results when comparing to other state-of-the-art salient object detection approaches.
引用
收藏
页码:483 / 495
页数:13
相关论文
共 53 条
[1]  
Avishek S, 2021, P IEEE INT C COMPUTE, P4136
[2]  
Chen ZY, 2020, AAAI CONF ARTIF INTE, V34, P10599
[3]   CIR-Net: Cross-Modality Interaction and Refinement for RGB-D Salient Object Detection [J].
Cong, Runmin ;
Lin, Qinwei ;
Zhang, Chen ;
Li, Chongyi ;
Cao, Xiaochun ;
Huang, Qingming ;
Zhao, Yao .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :6800-6815
[4]   Attentional Feature Fusion [J].
Dai, Yimian ;
Gieseke, Fabian ;
Oehmcke, Stefan ;
Wu, Yiquan ;
Barnard, Kobus .
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, :3559-3568
[5]  
Deng ZJ, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P684
[6]   Saliency Driven Total Variation Segmentation [J].
Donoser, Michael ;
Urschler, Martin ;
Hirzer, Martin ;
Bischof, Horst .
2009 IEEE 12TH INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2009, :817-824
[7]   Structure-measure: A New Way to Evaluate Foreground Maps [J].
Fan, Deng-Ping ;
Cheng, Ming-Ming ;
Liu, Yun ;
Li, Tao ;
Borji, Ali .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :4558-4567
[8]  
Fan DP, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P698
[9]   Salient Objects in Clutter: Bringing Salient Object Detection to the Foreground [J].
Fan, Deng-Ping ;
Cheng, Ming-Ming ;
Liu, Jiang-Jiang ;
Gao, Shang-Hua ;
Hou, Qibin ;
Borji, Ali .
COMPUTER VISION - ECCV 2018, PT 15, 2018, 11219 :196-212
[10]   Shifting More Attention to Video Salient Object Detection [J].
Fan, Deng-Ping ;
Wang, Wenguan ;
Cheng, Ming-Ming ;
Shen, Jianbing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :8546-8556