Global-Margin Uncertainty and Collaborative Sampling for Active Learning in Complex Aerial Images Object Detection

被引:0
作者
Zhu, Dongjun [1 ]
Gu, Chengjie [1 ,2 ]
Zhang, Junjun [1 ]
Yao, Yuyou [1 ]
Tan, Dayu [3 ]
机构
[1] Anhui Univ Sci & Technol, Sch Publ Secur & Emergency Management, Huainan 232001, Peoples R China
[2] Univ Sci & Technol China, Sch Informat Sci & Technol, Hefei 230027, Peoples R China
[3] Anhui Univ, Inst Phys Sci & Informat Technol, Key Lab Intelligent Comp & Signal Proc, Minist Educ, Hefei 230601, Peoples R China
关键词
Uncertainty; Object detection; Entropy; Learning systems; Training; Collaboration; Annotations; Active learning; aerial images; collaborative sampling (CS); global-margin uncertainty (GMU); object detection;
D O I
10.1109/LGRS.2024.3373038
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Object detection in aerial images based on deep learning requires a large amount of labeled data, whereas manual annotation of aerial images is time-consuming and laborious. As a branch of machine learning, active learning can help humans find valuable samples by designing some corresponding query strategies, which effectively reduces the cost of manual labeling. However, objects in aerial images are usually small, dense, and accompanied by interference from complex backgrounds. These bring considerable challenges for active learning in selecting high-value aerial image samples. Currently, there is a relative lack of study on active learning for aerial image object detection. Therefore, this letter proposes a novel active learning method, using global-margin uncertainty (GMU) and collaborative sampling (CS) to find out the highly valuable aerial image samples to reduce the annotation cost and improve the training efficiency of models. In GMU, the predicted scores of categories are applied to calculate the global uncertainty and margin uncertainty of unlabeled aerial images and then those aerial images with high uncertainty scores are selected as the candidate samples. In CS, we train a main model and an auxiliary model, respectively, to detect the candidate samples, where the samples with large differences in detection results of the two models are selected for manual annotation. The experiments conducted on VisDrone2019 and DOTA-v1.5 datasets show that the proposed method has a better performance compared with several state-of-the-art active learning methods.
引用
收藏
页数:5
相关论文
共 27 条
  • [11] Localization-Aware Active Learning for Object Detection
    Kao, Chieh-Chi
    Lee, Teng-Yok
    Sen, Pradeep
    Liu, Ming-Yu
    [J]. COMPUTER VISION - ACCV 2018, PT VI, 2019, 11366 : 506 - 522
  • [12] FoveaBox: Beyound Anchor-Based Object Detection
    Kong, Tao
    Sun, Fuchun
    Liu, Huaping
    Jiang, Yuning
    Li, Lei
    Shi, Jianbo
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 7389 - 7398
  • [13] Microsoft COCO: Common Objects in Context
    Lin, Tsung-Yi
    Maire, Michael
    Belongie, Serge
    Hays, James
    Perona, Pietro
    Ramanan, Deva
    Dollar, Piotr
    Zitnick, C. Lawrence
    [J]. COMPUTER VISION - ECCV 2014, PT V, 2014, 8693 : 740 - 755
  • [14] Deep Learning for Generic Object Detection: A Survey
    Liu, Li
    Ouyang, Wanli
    Wang, Xiaogang
    Fieguth, Paul
    Chen, Jie
    Liu, Xinwang
    Pietikainen, Matti
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2020, 128 (02) : 261 - 318
  • [15] Deep Reinforcement Active Learning for Human-In-The-Loop Person Re-Identification
    Liu, Zimo
    Wang, Jingya
    Gong, Shaogang
    Lu, Huchuan
    Tao, Dacheng
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6121 - 6130
  • [16] Deep Active Learning for Surface Defect Detection
    Lv, Xiaoming
    Duan, Fajie
    Jiang, Jia-Jia
    Fu, Xiao
    Gan, Lin
    [J]. SENSORS, 2020, 20 (06)
  • [17] Qu ZS, 2020, Arxiv, DOI arXiv:2003.08793
  • [18] Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
    Ren, Shaoqing
    He, Kaiming
    Girshick, Ross
    Sun, Jian
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) : 1137 - 1149
  • [19] Sener O., 2018, P INT C LEARN REPR
  • [20] Active learning for on-road vehicle detection: a comparative study
    Sivaraman, Sayanan
    Trivedi, Mohan M.
    [J]. MACHINE VISION AND APPLICATIONS, 2014, 25 (03) : 599 - 611