Perception-and-Regulation Network for Salient Object Detection

被引:6
|
作者
Zhu, Jinchao [1 ,2 ]
Zhang, Xiaoyu [1 ]
Fang, Xian [3 ]
Wang, Yuxuan [1 ]
Tan, Panlong [1 ]
Liu, Junnan [4 ]
机构
[1] Nankai Univ, Coll Artificial Intelligence, Tianjin 300350, Peoples R China
[2] Tsinghua Univ, Dept Automat, BNRist, Tianjin 300350, Peoples R China
[3] Nankai Univ, Coll Comp Sci, Tianjin 300350, Peoples R China
[4] Harbin Engn Univ, Coll Intelligent Syst Sci & Engn, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Semantics; Regulation; Object detection; Feature extraction; Convolution; Logic gates; Task analysis; Salient object detection; convolutional neural networks; attention mechanism; global perception; MODEL;
D O I
10.1109/TMM.2022.3210366
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Effective fusion of different types of features is the key to salient object detection (SOD). The majority of the existing network structure designs are based on the subjective experience of scholars, and the process of feature fusion does not consider the relationship between the fused features and the highest-level features. In this paper, we focus on the feature relationship and propose a novel global attention unit, which we term the "perception-and-regulation" (PR) block, that adaptively regulates the feature fusion process by explicitly modelling the interdependencies between features. The perception part uses the structure of the fully connected layers in the classification networks to learn the size and shape of the objects. The regulation part selectively strengthens and weakens the features to be fused. An imitating eye observation module (IEO) is further employed to improve the global perception capabilities of the network. The imitation of foveal vision and peripheral vision enables the IEO to scrutinize highly detailed objects and to organize a broad spatial scene to better segment objects. Sufficient experiments conducted on the SOD datasets demonstrate that the proposed method performs favourably against the 29 state-of-the-art methods.
引用
收藏
页码:6525 / 6537
页数:13
相关论文
共 50 条
  • [21] Exploring Dense Context for Salient Object Detection
    Mei, Haiyang
    Liu, Yuanyuan
    Wei, Ziqi
    Zhou, Dongsheng
    Wei, Xiaopeng
    Zhang, Qiang
    Yang, Xin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (03) : 1378 - 1389
  • [22] Consistency perception network for 360° omnidirectional salient object detection
    Wen, Hongfa
    Zhu, Zunjie
    Zhou, Xiaofei
    Zhang, Jiyong
    Yan, Chenggang
    NEUROCOMPUTING, 2025, 620
  • [23] Revisiting Feature Fusion for RGB-T Salient Object Detection
    Zhang, Qiang
    Xiao, Tonglin
    Huang, Nianchang
    Zhang, Dingwen
    Han, Jungong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (05) : 1804 - 1818
  • [24] Cross-Layer Feature Pyramid Network for Salient Object Detection
    Li, Zun
    Lang, Congyan
    Liew, Jun Hao
    Li, Yidong
    Hou, Qibin
    Feng, Jiashi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 4587 - 4598
  • [25] EDN: Salient Object Detection via Extremely-Downsampled Network
    Wu, Yu-Huan
    Liu, Yun
    Zhang, Le
    Cheng, Ming-Ming
    Ren, Bo
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 3125 - 3136
  • [26] Dynamic Selective Network for RGB-D Salient Object Detection
    Wen, Hongfa
    Yan, Chenggang
    Zhou, Xiaofei
    Cong, Runmin
    Sun, Yaoqi
    Zheng, Bolun
    Zhang, Jiyong
    Bao, Yongjun
    Ding, Guiguang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 9179 - 9192
  • [27] CGFNet: Cross-Guided Fusion Network for RGB-T Salient Object Detection
    Wang, Jie
    Song, Kechen
    Bao, Yanqi
    Huang, Liming
    Yan, Yunhui
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (05) : 2949 - 2961
  • [28] Stacked U-Shape Network With Channel-Wise Attention for Salient Object Detection
    Li, Junxia
    Pan, Zefeng
    Liu, Qingshan
    Wang, Ziyang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 1397 - 1409
  • [29] Boosting Broader Receptive Fields for Salient Object Detection
    Ma, Mingcan
    Xia, Changqun
    Xie, Chenxi
    Chen, Xiaowu
    Li, Jia
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 1026 - 1038
  • [30] Salient Object Detection by Fusing Local and Global Contexts
    Ren, Qinghua
    Lu, Shijian
    Zhang, Jinxia
    Hu, Renjie
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 1442 - 1453