Webly-supervised learning for salient object detection

被引:20
|
作者
Luo, Ao [1 ]
Li, Xin [2 ]
Yang, Fan [2 ]
Jiao, Zhicheng [3 ]
Cheng, Hong [1 ]
机构
[1] Univ Elect Sci & Technol China, Chengdu 611731, Peoples R China
[2] Incept Inst Artificial Intelligence, Abu Dhabi, U Arab Emirates
[3] Univ N Carolina, Chapel Hill, NC 27599 USA
关键词
Salient object detection; Webly-supervised learning; Deep learning; OPTIMIZATION; FRAMEWORK; FUSION;
D O I
10.1016/j.patcog.2020.107308
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
End-to-end training of a deep CNN-Based model for salient object detection usually requires a huge number of training samples with pixel-level annotations, which are costly and time-consuming to obtain. In this paper, we propose an approach that can utilize large amounts of web data for learning a deep salient object detection model. With thousands of images collected from the Web, we first employ several bottom-up saliency detection techniques to generate salient object masks for all images, and then use a novel quality evaluation method to pick out a subset of images with reliable masks for training. After that, we develop a self-training approach to boost the performance of our initial network, which iterates between the network training process and the training set updating process. Importantly, different from existing webly-supervised or weakly-supervised methods, our approach is able to automatically select reliable images for network training without requiring any human intervention (e.g., dividing images into different difficulty levels). Results of extensive experiments on several widely-used benchmarks demonstrate that our method has achieved state-of-the-art performance. It significantly outperforms existing unsupervised and weakly-supervised salient object detection methods, and achieves competitive or even better performance than fully supervised approaches. (C) 2020 Elsevier Ltd. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [41] Complementary characteristics fusion network for weakly supervised salient object detection
    Liu, Yan
    Zhang, Yunzhou
    Wang, Zhenyu
    Yang, Fei
    Qin, Cao
    Qiu, Feng
    Coleman, Sonya
    Kerr, Dermot
    IMAGE AND VISION COMPUTING, 2022, 126
  • [42] Weakly Supervised Salient Object Detection With Spatiotemporal Cascade Neural Networks
    Tang, Yi
    Zou, Wenbin
    Jin, Zhi
    Chen, Yuhuan
    Hua, Yang
    Li, Xia
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (07) : 1973 - 1984
  • [43] Salient Object Detection in the Deep Learning Era: An In-Depth Survey
    Wang, Wenguan
    Lai, Qiuxia
    Fu, Huazhu
    Shen, Jianbing
    Ling, Haibin
    Yang, Ruigang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (06) : 3239 - 3259
  • [44] Scribble-Supervised RGB-T Salient Object Detection
    Liu, Zhengyi
    Huang, Xiaoshen
    Zhang, Guanghui
    Fang, Xianyong
    Wang, Linbo
    Tang, Bin
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2369 - 2374
  • [45] CGDINet: A Deep Learning-Based Salient Object Detection Algorithm
    Hu, Chengyu
    Guo, Jianxin
    Xie, Hanfei
    Zhu, Qing
    Yuan, Baoxi
    Gao, Yujie
    Ma, Xiangyang
    Chen, Jialu
    Tian, Juan
    IEEE ACCESS, 2025, 13 : 4697 - 4723
  • [46] Mutual Information Regularization for Weakly-Supervised RGB-D Salient Object Detection
    Li, Aixuan
    Mao, Yuxin
    Zhang, Jing
    Dai, Yuchao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (01) : 397 - 410
  • [47] Weakly supervised salient object detection via bounding-box annotation and SAM model
    Liu, Xiangquan
    Huang, Xiaoming
    ELECTRONIC RESEARCH ARCHIVE, 2024, 32 (03): : 1624 - 1645
  • [48] Image Salient Object Detection Combined with Deep Learning
    Zhao Heng
    An Weisheng
    LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (12)
  • [49] Salient Object Detection in RGB-D Videos
    Mou, Ao
    Lu, Yukang
    He, Jiahao
    Min, Dingyao
    Fu, Keren
    Zhao, Qijun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 6660 - 6675
  • [50] Local to Global Feature Learning for Salient Object Detection
    Feng, Xuelu
    Zhou, Sanping
    Zhu, Zixin
    Wang, Le
    Hua, Gang
    PATTERN RECOGNITION LETTERS, 2022, 162 : 81 - 88