Webly-supervised learning for salient object detection

被引:20
|
作者
Luo, Ao [1 ]
Li, Xin [2 ]
Yang, Fan [2 ]
Jiao, Zhicheng [3 ]
Cheng, Hong [1 ]
机构
[1] Univ Elect Sci & Technol China, Chengdu 611731, Peoples R China
[2] Incept Inst Artificial Intelligence, Abu Dhabi, U Arab Emirates
[3] Univ N Carolina, Chapel Hill, NC 27599 USA
关键词
Salient object detection; Webly-supervised learning; Deep learning; OPTIMIZATION; FRAMEWORK; FUSION;
D O I
10.1016/j.patcog.2020.107308
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
End-to-end training of a deep CNN-Based model for salient object detection usually requires a huge number of training samples with pixel-level annotations, which are costly and time-consuming to obtain. In this paper, we propose an approach that can utilize large amounts of web data for learning a deep salient object detection model. With thousands of images collected from the Web, we first employ several bottom-up saliency detection techniques to generate salient object masks for all images, and then use a novel quality evaluation method to pick out a subset of images with reliable masks for training. After that, we develop a self-training approach to boost the performance of our initial network, which iterates between the network training process and the training set updating process. Importantly, different from existing webly-supervised or weakly-supervised methods, our approach is able to automatically select reliable images for network training without requiring any human intervention (e.g., dividing images into different difficulty levels). Results of extensive experiments on several widely-used benchmarks demonstrate that our method has achieved state-of-the-art performance. It significantly outperforms existing unsupervised and weakly-supervised salient object detection methods, and achieves competitive or even better performance than fully supervised approaches. (C) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Webly-Supervised Food Detection with Foodness Proposal
    Shimoda, Wataru
    Yanai, Keiji
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2019, E102D (07) : 1230 - 1239
  • [2] Webly-supervised semantic segmentation via curriculum learning
    Huang, Zuxian
    Wu, Gangshan
    Wang, Limin
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 236
  • [3] NoisyArt: A Dataset for Webly-supervised Artwork Recognition
    Del Chiaro, R.
    Bagdanov, Andrew
    Del Bimbo, A.
    VISAPP: PROCEEDINGS OF THE 14TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 4, 2019, : 467 - 475
  • [4] To Be Critical: Self-calibrated Weakly Supervised Learning for Salient Object Detection
    Wang, Jian
    Liu, Tingwei
    Zhang, Miao
    Piao, Yongri
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT XI, 2024, 14435 : 184 - 198
  • [5] WUSL–SOD: Joint weakly supervised, unsupervised and supervised learning for salient object detection
    Yan Liu
    Yunzhou Zhang
    Zhenyu Wang
    Rong Ma
    Feng Qiu
    Sonya Coleman
    Dermot Kerr
    Neural Computing and Applications, 2023, 35 : 15837 - 15856
  • [6] Semi-supervised Active Salient Object Detection
    Lv, Yunqiu
    Liu, Bowen
    Zhang, Jing
    Dai, Yuchao
    Li, Aixuan
    Zhang, Tong
    PATTERN RECOGNITION, 2022, 123
  • [7] A novel seminar learning framework for weakly supervised salient object detection
    Liu, Yan
    Zhang, Yunzhou
    Wang, Zhenyu
    Yang, Fei
    Qiu, Feng
    Coleman, Sonya
    Kerr, Dermot
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 126
  • [8] A Simple Mixed-Supervised Learning Method for Salient Object Detection
    Gong, Congjin
    Yang, Gang
    Dong, Haoyu
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, ICIC 2023, PT V, 2023, 14090 : 63 - 74
  • [9] Residual Learning for Salient Object Detection
    Feng, Mengyang
    Lu, Huchuan
    Yu, Yizhou
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 4696 - 4708
  • [10] WUSL-SOD: Joint weakly supervised, unsupervised and supervised learning for salient object detection
    Liu, Yan
    Zhang, Yunzhou
    Wang, Zhenyu
    Ma, Rong
    Qiu, Feng
    Coleman, Sonya
    Kerr, Dermot
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (21) : 15837 - 15856