Perception-and-Regulation Network for Salient Object Detection

被引:6
|
作者
Zhu, Jinchao [1 ,2 ]
Zhang, Xiaoyu [1 ]
Fang, Xian [3 ]
Wang, Yuxuan [1 ]
Tan, Panlong [1 ]
Liu, Junnan [4 ]
机构
[1] Nankai Univ, Coll Artificial Intelligence, Tianjin 300350, Peoples R China
[2] Tsinghua Univ, Dept Automat, BNRist, Tianjin 300350, Peoples R China
[3] Nankai Univ, Coll Comp Sci, Tianjin 300350, Peoples R China
[4] Harbin Engn Univ, Coll Intelligent Syst Sci & Engn, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Semantics; Regulation; Object detection; Feature extraction; Convolution; Logic gates; Task analysis; Salient object detection; convolutional neural networks; attention mechanism; global perception; MODEL;
D O I
10.1109/TMM.2022.3210366
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Effective fusion of different types of features is the key to salient object detection (SOD). The majority of the existing network structure designs are based on the subjective experience of scholars, and the process of feature fusion does not consider the relationship between the fused features and the highest-level features. In this paper, we focus on the feature relationship and propose a novel global attention unit, which we term the "perception-and-regulation" (PR) block, that adaptively regulates the feature fusion process by explicitly modelling the interdependencies between features. The perception part uses the structure of the fully connected layers in the classification networks to learn the size and shape of the objects. The regulation part selectively strengthens and weakens the features to be fused. An imitating eye observation module (IEO) is further employed to improve the global perception capabilities of the network. The imitation of foveal vision and peripheral vision enables the IEO to scrutinize highly detailed objects and to organize a broad spatial scene to better segment objects. Sufficient experiments conducted on the SOD datasets demonstrate that the proposed method performs favourably against the 29 state-of-the-art methods.
引用
收藏
页码:6525 / 6537
页数:13
相关论文
共 50 条
  • [1] Global Perception Network for Salient Object Detection in Remote Sensing Images
    Liu, Yu
    Zhang, Shanwen
    Wang, Zhen
    Zhao, Baoping
    Zou, Lincheng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [2] WFNet: A Wider and Finer Network for Salient Object Detection
    Cen, Jun
    Sun, Han
    Chen, Xinyi
    Liu, Ningzhong
    Liang, Dong
    Zhou, Huiyu
    IEEE ACCESS, 2020, 8 : 210418 - 210428
  • [3] Decomposition and Completion Network for Salient Object Detection
    Wu, Zhe
    Su, Li
    Huang, Qingming
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 6226 - 6239
  • [4] Hierarchical Feature Fusion Network for Salient Object Detection
    Li, Xuelong
    Song, Dawei
    Dong, Yongsheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 (29) : 9165 - 9175
  • [5] TCRNet: A Trifurcated Cascaded Refinement Network for Salient Object Detection
    Zhang, Qing
    Zhao, Rui
    Zhang, Liqian
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (01) : 298 - 311
  • [6] Boundary Information Progressive Guidance Network for Salient Object Detection
    Yao, Zhaojian
    Wang, Luping
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 4236 - 4249
  • [7] Embedding Attention and Residual Network for Accurate Salient Object Detection
    Chen, Shuhan
    Wang, Ben
    Tan, Xiuli
    Hu, Xuelong
    IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (05) : 2050 - 2062
  • [8] Deep Sub-Region Network for Salient Object Detection
    Wang, Liansheng
    Chen, Rongzhen
    Zhu, Lei
    Xie, Haoran
    Li, Xiaomeng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (02) : 728 - 741
  • [9] Salient Object Detection via Integrity Learning
    Zhuge, Mingchen
    Fan, Deng-Ping
    Liu, Nian
    Zhang, Dingwen
    Xu, Dong
    Shao, Ling
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) : 3738 - 3752
  • [10] CoGANet: Co-Guided Attention Network for Salient Object Detection
    Zhao, Yufei
    Song, Yong
    Li, Guoqi
    Huang, Yi
    Bai, Yashuo
    Zhou, Ya
    Hao, Qun
    IEEE PHOTONICS JOURNAL, 2022, 14 (04):