Weakly-Supervised Salient Object Detection With Saliency Bounding Boxes

被引:46
|
作者
Liu, Yuxuan [1 ]
Wang, Pengjie [1 ]
Cao, Ying [2 ]
Liang, Zijian [1 ]
Lau, Rynson W. H. [2 ]
机构
[1] Dalian Minzu Univ, Dept Comp Sci, Dalian, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
关键词
Object detection; Annotations; Detectors; Training; Proposals; Computer science; Task analysis; Saliency bounding boxes; salient object detection; weak supervision;
D O I
10.1109/TIP.2021.3071691
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a novel form of weak supervision for salient object detection (SOD) based on saliency bounding boxes, which are minimum rectangular boxes enclosing the salient objects. Based on this idea, we propose a novel weakly-supervised SOD method, by predicting pixel-level pseudo ground truth saliency maps from just saliency bounding boxes. Our method first takes advantage of the unsupervised SOD methods to generate initial saliency maps and addresses the over/under prediction problems, to obtain the initial pseudo ground truth saliency maps. We then iteratively refine the initial pseudo ground truth by learning a multi-task map refinement network with saliency bounding boxes. Finally, the final pseudo saliency maps are used to supervise the training of a salient object detector. Experimental results show that our method outperforms state-of-the-art weakly-supervised methods.
引用
收藏
页码:4423 / 4435
页数:13
相关论文
共 50 条
  • [1] Weakly-Supervised Salient Object Detection with Saliency Bounding Boxes
    Liu, Yuxuan
    Wang, Pengjie
    Cao, Ying
    Liang, Zijian
    Lau, Rynson W. H.
    IEEE Transactions on Image Processing, 2021, 30 : 4423 - 4435
  • [2] Weakly-Supervised Saliency Detection via Salient Object Subitizing
    Zheng, Xiaoyang
    Tan, Xin
    Zhou, Jie
    Ma, Lizhuang
    Lau, Rynson W. H.
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (11) : 4370 - 4380
  • [3] Weakly-Supervised Salient Object Detection on Light Fields
    Liang, Zijian
    Wang, Pengjie
    Xu, Ke
    Zhang, Pingping
    Lau, Rynson W. H.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 6295 - 6305
  • [4] Weakly-supervised object detection via mining pseudo ground truth bounding-boxes
    Zhang, Yongqiang
    Bai, Yaicheng
    Ding, Mingli
    Li, Yongqiang
    Ghanem, Bernard
    PATTERN RECOGNITION, 2018, 84 : 68 - 81
  • [5] Weakly-Supervised Salient Object Detection Using Point Supervison
    Gao, Shuyong
    Zhang, Wei
    Wang, Yan
    Guo, Qianyu
    Zhang, Chenglong
    He, Yangji
    Zhang, Wenqiang
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 670 - 678
  • [6] Weakly-supervised salient object detection with the multi-scale progressive network
    Liu X.
    Guo J.
    Zheng S.
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2023, 50 (01): : 48 - 57
  • [7] Mutual Information Regularization for Weakly-Supervised RGB-D Salient Object Detection
    Li, Aixuan
    Mao, Yuxin
    Zhang, Jing
    Dai, Yuchao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (01) : 397 - 410
  • [8] Weakly-supervised butterfly detection based on saliency map
    Zhang, Ting
    Waqas, Muhammad
    Fang, Yu
    Liu, Zhaoying
    Halim, Zahid
    Li, Yujian
    Chen, Sheng
    PATTERN RECOGNITION, 2023, 138
  • [9] Bounding boxes for weakly-supervised breast cancer segmentation in DCE-MRI
    Zhong, Yuming
    Xu, Zeyan
    Han, Chu
    Liu, Zaiyi
    Wang, Yi
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 105
  • [10] Single-shot weakly-supervised object detection guided by empirical saliency model
    Zhao, Danpei
    Yuan, Zhichao
    Shi, Zhenwei
    Xie, Fengying
    NEUROCOMPUTING, 2021, 455 : 431 - 440