Construction of multi-channel fusion salient object detection network based on gating mechanism and pooling network

被引:1
|
作者
Ning, Li [1 ,2 ]
Jincai, Huang [1 ]
Yanghe, Feng [1 ]
机构
[1] Natl Univ Def Technol, Coll Syst Engn, Changsha, Hunan, Peoples R China
[2] China Inst Marine Technol & Econ, Marine Human Factors Engn Lab, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Salienct object recognition; Gating mechanism; Pooling network; Multi-channel fusion; Convolutional Neural network;
D O I
10.1007/s11042-021-11031-7
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We combine SNet network based on gating mechanism with poolnet network to solve the problem of salient object detection. The network construction of this paper is based on FPN, which is a classic U-net backbone network. Inspired by poolnet, we also introduce the global feature guidance module. By aggregating the high-level semantic information into the transposition convolution stage of different scales, the higher-level semantic features can be used more effectively. Although the introduction of global information can effectively improve the effect of saliency monitoring, how to aggregate the global and local features of different scales still needs to be further explored. Inspired by SNet network, we also integrate snet into our network. In the specific feature fusion process, the feature values of different channels are weighted, and each channel is given different weights. The more important semantic information is extracted from multiple channels, and the key semantic information in the feature map is retained. Compared with the current typical methods, we find that the introduction of snet module can reduce the generation of error areas of saliency map, and further improve the integrity of saliency map. For different regions of the same object, due to the difference of color contrast and texture, the saliency map generated by the previous method is inconsistent in the same object region. Our method can effectively solve this problem. For the same object, we can generate consistent results of saliency probability. Through quantitative evaluation with the existing 15 methods (including SOTA method). Our network can process 300 * 267 images faster than 11FPS, which is at a medium level compared with the most advanced networks. These networks include DGRL, PiCANet, PoolNet and so on. The Precision and Recall curve results show that our network performs well on DUT-O, DUT-S and ECSSD data sets, and the minimum precision values are all above 0.47. The false positive prediction of salient objects in the graph is low, and the overall performance of the model is good.
引用
收藏
页码:12111 / 12126
页数:16
相关论文
共 50 条
  • [1] Construction of multi-channel fusion salient object detection network based on gating mechanism and pooling network
    Li Ning
    Huang Jincai
    Feng Yanghe
    Multimedia Tools and Applications, 2022, 81 : 12111 - 12126
  • [2] Multi-scale Pyramid Pooling Network for salient object detection
    Dakhia, Abdelhafid
    Wang, Tiantian
    Lu, Huchuan
    NEUROCOMPUTING, 2019, 333 : 211 - 220
  • [3] A pooling-based feature pyramid network for salient object detection
    Shi, Caijuan
    Zhang, Weiming
    Duan, Changyu
    Chen, Houru
    IMAGE AND VISION COMPUTING, 2021, 107
  • [4] Multi-attention guided feature fusion network for salient object detection
    Li, Anni
    Qi, JinQing
    Lu, Huchuan
    NEUROCOMPUTING, 2020, 411 : 416 - 427
  • [5] MAFNet: Multi-style attention fusion network for salient object detection
    Liang, Yanhua
    Qin, Guihe
    Sun, Minghui
    Yan, Jie
    Jiang, Huiming
    NEUROCOMPUTING, 2021, 422 : 22 - 33
  • [6] Multi-branch feature fusion and refinement network for salient object detection
    Yang, Jinyu
    Shi, Yanjiao
    Zhang, Jin
    Guo, Qianqian
    Zhang, Qing
    Cui, Liu
    MULTIMEDIA SYSTEMS, 2024, 30 (04)
  • [7] Feature extraction and fusion network for salient object detection
    Dai, Chao
    Pan, Chen
    He, Wei
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (23) : 33955 - 33969
  • [8] Hierarchical Feature Fusion Network for Salient Object Detection
    Li, Xuelong
    Song, Dawei
    Dong, Yongsheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) : 9165 - 9175
  • [9] Feature extraction and fusion network for salient object detection
    Chao Dai
    Chen Pan
    Wei He
    Multimedia Tools and Applications, 2022, 81 : 33955 - 33969
  • [10] Selective feature fusion network for salient object detection
    Sun, Fengming
    Yuan, Xia
    Zhao, Chunxia
    IET COMPUTER VISION, 2023, 17 (04) : 483 - 495