Perception-and-Regulation Network for Salient Object Detection

被引:6
|
作者
Zhu, Jinchao [1 ,2 ]
Zhang, Xiaoyu [1 ]
Fang, Xian [3 ]
Wang, Yuxuan [1 ]
Tan, Panlong [1 ]
Liu, Junnan [4 ]
机构
[1] Nankai Univ, Coll Artificial Intelligence, Tianjin 300350, Peoples R China
[2] Tsinghua Univ, Dept Automat, BNRist, Tianjin 300350, Peoples R China
[3] Nankai Univ, Coll Comp Sci, Tianjin 300350, Peoples R China
[4] Harbin Engn Univ, Coll Intelligent Syst Sci & Engn, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Semantics; Regulation; Object detection; Feature extraction; Convolution; Logic gates; Task analysis; Salient object detection; convolutional neural networks; attention mechanism; global perception; MODEL;
D O I
10.1109/TMM.2022.3210366
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Effective fusion of different types of features is the key to salient object detection (SOD). The majority of the existing network structure designs are based on the subjective experience of scholars, and the process of feature fusion does not consider the relationship between the fused features and the highest-level features. In this paper, we focus on the feature relationship and propose a novel global attention unit, which we term the "perception-and-regulation" (PR) block, that adaptively regulates the feature fusion process by explicitly modelling the interdependencies between features. The perception part uses the structure of the fully connected layers in the classification networks to learn the size and shape of the objects. The regulation part selectively strengthens and weakens the features to be fused. An imitating eye observation module (IEO) is further employed to improve the global perception capabilities of the network. The imitation of foveal vision and peripheral vision enables the IEO to scrutinize highly detailed objects and to organize a broad spatial scene to better segment objects. Sufficient experiments conducted on the SOD datasets demonstrate that the proposed method performs favourably against the 29 state-of-the-art methods.
引用
收藏
页码:6525 / 6537
页数:13
相关论文
共 50 条
  • [31] Deep Salient Object Detection With Contextual Information Guidance
    Liu, Yi
    Han, Jungong
    Zhang, Qiang
    Shan, Caifeng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 360 - 374
  • [32] Pyramid Spatial Context Features for Salient Object Detection
    Li, Hui
    IEEE ACCESS, 2020, 8 : 88518 - 88526
  • [33] HRTransNet: HRFormer-Driven Two-Modality Salient Object Detection
    Tang, Bin
    Liu, Zhengyi
    Tan, Yacheng
    He, Qian
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (02) : 728 - 742
  • [34] LFRNet: Localizing, Focus, and Refinement Network for Salient Object Detection of Surface Defects
    Wan, Bin
    Zhou, Xiaofei
    Zheng, Bolun
    Yin, Haibing
    Zhu, Zunjie
    Wang, Hongkui
    Sun, Yaoqi
    Zhang, Jiyong
    Yan, Chenggang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [35] RFLNet: Reverse Feature Learning Network for Salient Object Detection in Forward-Looking Sonar Images
    He, Fu-Lin
    Wang, Zhen
    Yuan, Shen-Ao
    Zhang, Shan-Wen
    Zhao, Zheng-Yang
    IEEE ACCESS, 2024, 12 : 155437 - 155450
  • [36] Multi-Level Context Aggregation Network With Channel-Wise Attention for Salient Object Detection
    Jia, Zihui
    Weng, Zhenyu
    Wan, Fang
    Zhu, Yuesheng
    IEEE ACCESS, 2020, 8 : 102303 - 102312
  • [37] Efficient Context-Guided Stacked Refinement Network for RGB-T Salient Object Detection
    Huo, Fushuo
    Zhu, Xuegui
    Zhang, Lei
    Liu, Qifeng
    Shu, Yu
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (05) : 3111 - 3124
  • [38] SIHENet: Semantic Interaction and Hierarchical Embedding Network for 360° Salient Object Detection
    He, Zhentao
    Shao, Feng
    Xie, Zhengxuan
    Chai, Xiongli
    Ho, Yo-Sung
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
  • [39] Hierarchical and Interactive Refinement Network for Edge-Preserving Salient Object Detection
    Zhou, Sanping
    Wang, Jinjun
    Wang, Le
    Zhang, Jimuyang
    Wang, Fei
    Huang, Dong
    Zheng, Nanning
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 1 - 14
  • [40] Lightweight Salient Object Detection via Hierarchical Visual Perception Learning
    Liu, Yun
    Gu, Yu-Chao
    Zhang, Xin-Yu
    Wang, Weiwei
    Cheng, Ming-Ming
    IEEE TRANSACTIONS ON CYBERNETICS, 2021, 51 (09) : 4439 - 4449