Semi-supervised object detection with uncurated unlabeled data for remote sensing images

被引:18
作者
Liu, Nanqing [1 ,2 ]
Xu, Xun [1 ,2 ]
Gao, Yingjie [3 ]
Zhao, Yitao [1 ]
Li, Heng-Chao [1 ]
机构
[1] Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 611756, Peoples R China
[2] ASTAR, I2R, Singapore 138632, Singapore
[3] Beihang Univ, Sch Comp Sci & Engn, Beijing 100191, Peoples R China
基金
中国国家自然科学基金;
关键词
Remote sensing images; Semi-supervised learning; Open-set semi-supervised learning; Object detection; Memory bank; Adaptive threshold;
D O I
10.1016/j.jag.2024.103814
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Annotating remote sensing images (RSIs) poses a significant challenge, primarily due to its labor-intensive nature. Semi -supervised object detection (SSOD) methods address this challenge by generating pseudo -labels for unlabeled data, assuming that all classes present in the unlabeled dataset are also represented in the labeled data. However, real -world scenarios may lead to a mixture of out -of -distribution (OOD) samples and in -distribution (ID) samples within the unlabeled dataset. In this paper, we extensively explore techniques for conducting SSOD directly on uncurated unlabeled data, termed Open -Set Semi -Supervised Object Detection (OSSOD). Our approach begins by utilizing labeled in -distribution data to dynamically construct a class -wise feature bank (CFB) that captures features specific to each class. Subsequently, we compare the features of predicted object bounding boxes with the corresponding entries in the CFB to calculate OOD scores. We design an adaptive threshold based on the statistical properties of the CFB to accommodate different classes, allowing us to effectively filter out OOD samples. The effectiveness of our proposed method is substantiated through extensive experiments on two widely used remote sensing object detection datasets: DIOR and DOTA. These experiments demonstrate the superior performance and efficacy of our OSSOD approach on RSIs. The code is available at http://github.com/Lans1ng/OSSOD.
引用
收藏
页数:11
相关论文
共 36 条
[1]   Emerging Properties in Self-Supervised Vision Transformers [J].
Caron, Mathilde ;
Touvron, Hugo ;
Misra, Ishan ;
Jegou, Herve ;
Mairal, Julien ;
Bojanowski, Piotr ;
Joulin, Armand .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :9630-9640
[2]   Self-Guided Proposal Generation for Weakly Supervised Object Detection [J].
Cheng, Gong ;
Xie, Xuan ;
Chen, Weining ;
Feng, Xiaoxu ;
Yao, Xiwen ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[3]   Prototype-CNN for Few-Shot Object Detection in Remote Sensing Images [J].
Cheng, Gong ;
Yan, Bowei ;
Shi, Peizhen ;
Li, Ke ;
Yao, Xiwen ;
Guo, Lei ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[4]   Weakly Supervised Rotation-Invariant Aerial Object Detection Network [J].
Feng, Xiaoxu ;
Yao, Xiwen ;
Cheng, Gong ;
Han, Junwei .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, :14126-14135
[5]  
Gu Xiaoyi, 2019, ADV NEUR IN, V32
[6]   Capsule-inferenced Object Detection for Remote Sensing Images [J].
Han, Yingchao ;
Meng, Weixiao ;
Tang, Wei .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 :5260-5270
[7]  
Hendrycks D., 2016, P INT C LEARN REPR
[8]  
Hendrycks Dan, 2019, ICLR
[9]   Generalized ODIN: Detecting Out-of-distribution Image without Learning from Out-of-distribution Data [J].
Hsu, Yen-Chang ;
Shen, Yilin ;
Jin, Hongxia ;
Kira, Zsolt .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :10948-10957
[10]   SOOD: Towards Semi-Supervised Oriented Object Detection [J].
Hua, Wei ;
Liang, Dingkang ;
Li, Jingyu ;
Liu, Xiaolong ;
Zou, Zhikang ;
Ye, Xiaoqing ;
Bai, Xiang .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, :15558-15567