IDO: Instance dual-optimization for weakly supervised object detection

被引:0
|
作者
Ren, Zhida [1 ,2 ]
Tang, Yongqiang [1 ]
Zhang, Wensheng [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Multimodel Artificial Intelligence, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Weakly supervised learning; Object detection; Multiple instance learning;
D O I
10.1007/s10489-023-04956-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly supervised object detection (WSOD) has attracted significant attention in recent years, as it utilizes only image-level annotations to train object detectors and greatly reduces the labor and capital cost of fine labeling. Nevertheless, the absence of instance-level annotations leads to two phenomena: partial regions and missing instances. We believe these are mainly caused by two issues: 1) Noisy instances exist in the training samples, which can confuse the detector. 2) Global salient information is missing, resulting in little attention being received in the low-confidence region. To solve the above two problems, we propose an instance dual-optimization framework called IDO. First, an instance-wise selection strategy (IWSS) based on curriculum learning is proposed for instance denoising and for improving the robustness of the model. Second, CAM-generated spatial attention (CGSA) is carefully designed to optimize the features of instances. Without introducing additional hyperparameters, our CGSA complements the low class-confidence region with more global salient information, which assists the model in acquiring a more complete region of the target and identifying more neglected targets. Finally, we empirically demonstrate that our proposal can achieve comparable results to those of other state-of-the-art methods on PASCAL VOC 2007, PASCAL VOC 2012, and MS COCO.
引用
收藏
页码:26763 / 26780
页数:18
相关论文
共 50 条
  • [41] Objectness Consistent Representation for Weakly Supervised Object Detection
    Yang, Ke
    Zhang, Peng
    Qiao, Peng
    Wang, Zhiyuan
    Li, Dongsheng
    Dou, Yong
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 1688 - 1696
  • [42] Weakly Supervised Object Detection Based on Active Learning
    Wang, Xiao
    Xiang, Xiang
    Zhang, Baochang
    Liu, Xuhui
    Zheng, Jianying
    Hu, Qinglei
    NEURAL PROCESSING LETTERS, 2022, 54 (06) : 5169 - 5183
  • [43] Weakly Supervised Learning of Instance Segmentation with Confidence Feedback
    Yang, Yu
    Wan, Fang
    Ye, Qixiang
    Ji, Xiangyang
    ARTIFICIAL INTELLIGENCE, CICAI 2022, PT I, 2022, 13604 : 392 - 403
  • [44] Weakly Supervised Object Detection Based on Active Learning
    Xiao Wang
    Xiang Xiang
    Baochang Zhang
    Xuhui Liu
    Jianying Zheng
    QingLei Hu
    Neural Processing Letters, 2022, 54 : 5169 - 5183
  • [45] Towards automatic visual inspection: A weakly supervised learning method for industrial applicable object detection
    Ge, Ce
    Wang, Jing
    Wang, Jingyu
    Qi, Qi
    Sun, Haifeng
    Liao, Jianxin
    COMPUTERS IN INDUSTRY, 2020, 121
  • [46] Single-shot weakly-supervised object detection guided by empirical saliency model
    Zhao, Danpei
    Yuan, Zhichao
    Shi, Zhenwei
    Xie, Fengying
    NEUROCOMPUTING, 2021, 455 : 431 - 440
  • [47] Weakly Supervised Large Scale Object Localization with Multiple Instance Learning and Bag Splitting
    Ren, Weiqiang
    Huang, Kaiqi
    Tao, Dacheng
    Tan, Tieniu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) : 405 - 416
  • [48] Multiple Instance Deep Learning for Weakly Supervised Small-Footprint Audio Event Detection
    Tseng, Shao-Yen
    Li, Juncheng
    Wang, Yun
    Metze, Florian
    Szurley, Joseph
    Das, Samarjit
    19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, : 3279 - 3283
  • [49] Weakly supervised instance attention for multisource fine-grained object recognition with an application to tree species classification
    Aygunes, Bulut
    Cinbis, Ramazan Gokberk
    Aksoy, Selim
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 176 : 262 - 274
  • [50] Weakly Supervised Foreground Object Detection Network Using Background Model Image
    Kim, Jae-Yeul
    Ha, Jong-Eun
    IEEE ACCESS, 2022, 10 : 105726 - 105733