Unsupervised Domain Adaptation With Debiased Contrastive Learning and Support-Set Guided Pseudolabeling for Remote Sensing Images

被引:18
作者
Biswas, Debojyoti [1 ]
Tesic, Jelena [1 ]
机构
[1] Texas State Univ, Dept Comp Sci, San Marcos, TX 78666 USA
关键词
Debiased contrastive learning (DCL); object detection; remote sensing analytics; unmanned aerial vehicle (UAV) images; unsupervised domain adaptation (UDA);
D O I
10.1109/JSTARS.2024.3349541
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The variability in different altitudes, geographical variances, and weather conditions across datasets degrade state-of-the-art (SOTA) deep neural network object detection performance. Unsupervised and semisupervised domain adaptations (DAs) are decent solutions to bridge the gap between two different distributions of datasets. The SOTA pseudolabeling process is susceptible to background noise, hindering the optimal performance in target datasets. The existing contrastive DA methods overlook the bias effect introduced from the false negative (FN) target samples, which mislead the complete learning process. This article proposes support-guided debiased contrastive learning for DA to properly label the unlabeled target dataset and remove the bias toward target detection. We introduce: 1) a support-set curated approach to generate high-quality pseudolabels from the target dataset proposals; 2) a reduced distribution gap across different datasets using domain alignment on local, global, and instance-aware features for remote sensing datasets; and 3) novel debiased contrastive loss function that makes the model more robust for the variable appearance of a particular class over images and domains. The proposed debiased contrastive learning pivots on class probabilities to address the challenge of FNs in the unsupervised framework. Our model outperforms the compared SOTA models with a minimum gain of +3.9%, +3.2%, +12.7%, and +2.1% of mean average precision for DIOR, DOTA, Visdrone, and UAVDT datasets, respectively.
引用
收藏
页码:3197 / 3210
页数:14
相关论文
共 57 条
[1]  
Arthur D, 2007, PROCEEDINGS OF THE EIGHTEENTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, P1027
[2]  
Babavalian M., 2023, Multimedia Tools Appl., V83, P1
[3]   Robust and Rotation-Equivariant Contrastive Learning [J].
Bai, Gairui ;
Xi, Wei ;
Hong, Xiaopeng ;
Liu, Xinhui ;
Yue, Yang ;
Zhao, Songwen .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, :1-14
[4]  
Biswas Debojyoti, 2022, 2022 14th International Conference on Computational Intelligence and Communication Networks (CICN), P125, DOI 10.1109/CICN56167.2022.10008383
[5]  
Biswas D., 2022, PROC IEEE INT C NETW, P1
[6]  
Biswas D, 2023, Arxiv, DOI [arXiv:2209.02564, 10.48550/arXiv.2209.02564 2209.02564, DOI 10.48550/ARXIV.2209.02564]
[7]  
Bochkovskiy A, 2020, Arxiv, DOI arXiv:2004.10934
[8]  
BookingHunterTV, 2019, New York City Walking Tour Part 1-Midtown Manhattan
[9]   Harmonizing Transferability and Discriminability for Adapting Object Detectors [J].
Chen, Chaoqi ;
Zheng, Zebiao ;
Ding, Xinghao ;
Huang, Yue ;
Dou, Qi .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :8866-8875
[10]   Unsupervised Domain Adaptation for Semantic Segmentation of High-Resolution Remote Sensing Imagery Driven by Category-Certainty Attention [J].
Chen, Jie ;
Zhu, Jingru ;
Guo, Ya ;
Sun, Geng ;
Zhang, Yi ;
Deng, Min .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60