IDO: Instance dual-optimization for weakly supervised object detection

被引:0
|
作者
Ren, Zhida [1 ,2 ]
Tang, Yongqiang [1 ]
Zhang, Wensheng [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Multimodel Artificial Intelligence, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Weakly supervised learning; Object detection; Multiple instance learning;
D O I
10.1007/s10489-023-04956-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly supervised object detection (WSOD) has attracted significant attention in recent years, as it utilizes only image-level annotations to train object detectors and greatly reduces the labor and capital cost of fine labeling. Nevertheless, the absence of instance-level annotations leads to two phenomena: partial regions and missing instances. We believe these are mainly caused by two issues: 1) Noisy instances exist in the training samples, which can confuse the detector. 2) Global salient information is missing, resulting in little attention being received in the low-confidence region. To solve the above two problems, we propose an instance dual-optimization framework called IDO. First, an instance-wise selection strategy (IWSS) based on curriculum learning is proposed for instance denoising and for improving the robustness of the model. Second, CAM-generated spatial attention (CGSA) is carefully designed to optimize the features of instances. Without introducing additional hyperparameters, our CGSA complements the low class-confidence region with more global salient information, which assists the model in acquiring a more complete region of the target and identifying more neglected targets. Finally, we empirically demonstrate that our proposal can achieve comparable results to those of other state-of-the-art methods on PASCAL VOC 2007, PASCAL VOC 2012, and MS COCO.
引用
收藏
页码:26763 / 26780
页数:18
相关论文
共 50 条
  • [1] IDO: Instance dual-optimization for weakly supervised object detection
    Zhida Ren
    Yongqiang Tang
    Wensheng Zhang
    Applied Intelligence, 2023, 53 : 26763 - 26780
  • [2] Discrepant multiple instance learning for weakly supervised object detection
    Gao, Wei
    Wan, Fang
    Yue, Jun
    Xu, Songcen
    Ye, Qixiang
    PATTERN RECOGNITION, 2022, 122
  • [3] Multiple Instance Graph Learning for Weakly Supervised Remote Sensing Object Detection
    Wang, Binglu
    Zhao, Yongqiang
    Li, Xuelong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] Continuation Multiple Instance Learning for Weakly and Fully Supervised Object Detection
    Ye, Qixiang
    Wan, Fang
    Liu, Chang
    Huang, Qingming
    Ji, Xiangyang
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (10) : 5452 - 5466
  • [5] Salient-aware multiple instance learning optimized network for weakly supervised object detection
    Zhang, Han
    Wang, Yongfang
    Yang, Yingjie
    VISUAL COMPUTER, 2024, 40 (11) : 8227 - 8242
  • [6] Multiple instance learning on deep features for weakly supervised object detection with extreme domain shifts
    Nicolas, Gonthier
    Ladjal, Said
    Gousseau, Yann
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2022, 214
  • [7] Dynamic sample weighting for weakly supervised object detection
    Li, Xuewei
    Yi, Song
    Zhang, Ruixuan
    Fu, Xuzhou
    Jiang, Han
    Wang, Chenhan
    Liu, Zhiqiang
    Gao, Jie
    Yu, Jian
    Yu, Mei
    Yu, Ruiguo
    IMAGE AND VISION COMPUTING, 2022, 122
  • [8] Pyramidal Multiple Instance Detection Network With Mask Guided Self-Correction for Weakly Supervised Object Detection
    Xu, Yunqiu
    Zhou, Chunluan
    Yu, Xin
    Xiao, Bin
    Yang, Yi
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 3029 - 3040
  • [9] Weakly Supervised Object Localization and Detection: A Survey
    Zhang, Dingwen
    Han, Junwei
    Cheng, Gong
    Yang, Ming-Hsuan
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (09) : 5866 - 5885
  • [10] Motion Context Network for Weakly Supervised Object Detection in Videos
    Jin, Ruibing
    Lin, Guosheng
    Wen, Changyun
    Wang, Jianliang
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 1864 - 1868