IDO: Instance dual-optimization for weakly supervised object detection

被引:0
|
作者
Ren, Zhida [1 ,2 ]
Tang, Yongqiang [1 ]
Zhang, Wensheng [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Automat, State Key Lab Multimodel Artificial Intelligence, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Weakly supervised learning; Object detection; Multiple instance learning;
D O I
10.1007/s10489-023-04956-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Weakly supervised object detection (WSOD) has attracted significant attention in recent years, as it utilizes only image-level annotations to train object detectors and greatly reduces the labor and capital cost of fine labeling. Nevertheless, the absence of instance-level annotations leads to two phenomena: partial regions and missing instances. We believe these are mainly caused by two issues: 1) Noisy instances exist in the training samples, which can confuse the detector. 2) Global salient information is missing, resulting in little attention being received in the low-confidence region. To solve the above two problems, we propose an instance dual-optimization framework called IDO. First, an instance-wise selection strategy (IWSS) based on curriculum learning is proposed for instance denoising and for improving the robustness of the model. Second, CAM-generated spatial attention (CGSA) is carefully designed to optimize the features of instances. Without introducing additional hyperparameters, our CGSA complements the low class-confidence region with more global salient information, which assists the model in acquiring a more complete region of the target and identifying more neglected targets. Finally, we empirically demonstrate that our proposal can achieve comparable results to those of other state-of-the-art methods on PASCAL VOC 2007, PASCAL VOC 2012, and MS COCO.
引用
收藏
页码:26763 / 26780
页数:18
相关论文
共 50 条
  • [21] Refining and Selecting Pseudo Ground Truth for Weakly-Supervised Object Detection
    Kim, Se-Hun
    Seo, Min-Seok
    Park, Chun-Myung
    Lee, Kyujoong
    Lee, Hyuk-Jae
    2021 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS-ASIA (ICCE-ASIA), 2021,
  • [22] Weakly Supervised Object Detection Based on Feature Self-Distillation Mechanism
    Gao Wenlong
    Chen Ying
    Peng Yong
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (04)
  • [23] WSODet: A Weakly Supervised Oriented Detector for Aerial Object Detection
    Tan, Zhiwen
    Jiang, Zhiguo
    Guo, Chen
    Zhang, Haopeng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [24] Weakly supervised object detection with interactive edge attentive collaboration
    Gao, Wenlong
    Chen, Ying
    Peng, Yong
    2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, : 1398 - 1403
  • [25] Learning an Invariant and Equivariant Network for Weakly Supervised Object Detection
    Feng, Xiaoxu
    Yao, Xiwen
    Shen, Hui
    Cheng, Gong
    Xiao, Bin
    Han, Junwei
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (10) : 11977 - 11992
  • [26] A Weakly Supervised Object Detection Model for Cyborgs in Smart Cities
    Xing, Shiyi
    Xing, Jinsheng
    Ju, Jianguo
    Hou, Qingshan
    She, Jiao
    Liu, Bosheng
    HUMAN-CENTRIC COMPUTING AND INFORMATION SCIENCES, 2023, 13
  • [27] Efficient Weakly-Supervised Object Detection With Pseudo Annotations
    Yuan, Qingsheng
    Sun, Gang
    Liang, Jianming
    Leng, Biao
    IEEE ACCESS, 2021, 9 : 104356 - 104366
  • [28] Weakly-supervised Human-object Interaction Detection
    Sugimoto, Masaki
    Furuta, Ryosuke
    Taniguchi, Yukinobu
    VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 5: VISAPP, 2021, : 293 - 300
  • [29] An Improved Adaptive Angle Weakly Supervised Learning Object Detection
    Chen, Yantong
    Shi, Yuxin
    Ren, Jianzhao
    Li, Jiabao
    2024 IEEE 24TH INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY, QRS, 2024, : 494 - 503
  • [30] A Weakly Supervised Object Detection Method Based on Attention Mechanism
    Liu, Hanchao
    Zhou, Diancheng
    Zhao, Yang
    Dong, Lanfang
    THIRTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2021), 2022, 12083