To Be Critical: Self-calibrated Weakly Supervised Learning for Salient Object Detection

被引:0
|
作者
Wang, Jian [1 ]
Liu, Tingwei [1 ]
Zhang, Miao [1 ,2 ]
Piao, Yongri [1 ]
机构
[1] Dalian Univ Technol, Dalian, Peoples R China
[2] Key Lab Ubiquitous Network & Serv Software Liaoni, Dalian, Peoples R China
来源
PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT XI | 2024年 / 14435卷
基金
中国国家自然科学基金;
关键词
Salient object detection; Weakly supervised learning; Deep learning;
D O I
10.1007/978-981-99-8552-4_15
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly-supervised salient object detection (WSOD) aims to develop saliency models using image-level annotations. Despite of the success of previous works, explorations on an effective training strategy for the saliency network and accurate matches between image-level annotations and salient objects are still inadequate. In this work, 1) we propose a self-calibrated training strategy by explicitly establishing a mutual calibration loop between pseudo labels and network predictions, liberating the saliency network from error-prone propagation caused by pseudo labels. 2) we prove that even a much smaller dataset (merely 1.8% of ImageNet) with well-matched annotations can facilitate models to achieve better performance as well as generalizability. This sheds new light on the development of WSOD and encourages more contributions to the community. Comprehensive experiments demonstrate that our method outperforms all the existing WSOD methods by adopting the self-calibrated strategy only. Steady improvements are further achieved by training on the proposed dataset. Additionally, our method achieves 94.7% of the performance of fully-supervised methods on average. And what is more, the fully supervised models adopting our predicted results as "ground truths" achieve successful results (95.6% for BASNet and 97.3% for ITSD on F-measure), while costing only 0.32% of labeling time for pixel-level annotation. The code and dataset are available at https://github.com/DUTyimmy/SCW.
引用
收藏
页码:184 / 198
页数:15
相关论文
共 50 条
  • [1] Self-progress aggregate learning for weakly supervised salient object detection
    Sun, Wanchun
    Feng, Xin
    Liu, Jingyao
    Ma, Hui
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2023, 34 (06)
  • [2] Noise-Sensitive Adversarial Learning for Weakly Supervised Salient Object Detection
    Piao, Yongri
    Wu, Wei
    Zhang, Miao
    Jiang, Yongyao
    Lu, Huchuan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 2888 - 2897
  • [3] A novel seminar learning framework for weakly supervised salient object detection
    Liu, Yan
    Zhang, Yunzhou
    Wang, Zhenyu
    Yang, Fei
    Qiu, Feng
    Coleman, Sonya
    Kerr, Dermot
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 126
  • [4] Self Paced Deep Learning for Weakly Supervised Object Detection
    Sangineto, Enver
    Nabi, Moin
    Culibrk, Dubravko
    Sebe, Nicu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (03) : 712 - 725
  • [5] WUSL–SOD: Joint weakly supervised, unsupervised and supervised learning for salient object detection
    Yan Liu
    Yunzhou Zhang
    Zhenyu Wang
    Rong Ma
    Feng Qiu
    Sonya Coleman
    Dermot Kerr
    Neural Computing and Applications, 2023, 35 : 15837 - 15856
  • [6] Weakly Supervised Salient Object Detection with Box Annotation
    Jiang, Zhentao
    Chen, Qiang
    Jiang, Bo
    Leng, Cong
    Cheng, Jian
    PATTERN RECOGNITION, ACPR 2021, PT I, 2022, 13188 : 197 - 211
  • [7] WUSL-SOD: Joint weakly supervised, unsupervised and supervised learning for salient object detection
    Liu, Yan
    Zhang, Yunzhou
    Wang, Zhenyu
    Ma, Rong
    Qiu, Feng
    Coleman, Sonya
    Kerr, Dermot
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (21) : 15837 - 15856
  • [8] A Weakly Supervised Learning Framework for Salient Object Detection via Hybrid Labels
    Cong, Runmin
    Qin, Qi
    Zhang, Chen
    Jiang, Qiuping
    Wang, Shiqi
    Zhao, Yao
    Kwong, Sam
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (02) : 534 - 548
  • [9] Survey on deep learning-based weakly supervised salient object detection
    Du, Lina
    Ma, Chunjie
    Chen, Junhao
    Zheng, Huimin
    Nie, Xiushan
    Gao, Zan
    EXPERT SYSTEMS WITH APPLICATIONS, 2025, 281
  • [10] Complementary characteristics fusion network for weakly supervised salient object detection
    Liu, Yan
    Zhang, Yunzhou
    Wang, Zhenyu
    Yang, Fei
    Qin, Cao
    Qiu, Feng
    Coleman, Sonya
    Kerr, Dermot
    IMAGE AND VISION COMPUTING, 2022, 126