DMRS: Long-tailed remote sensing recognition via semantic-aware mixing and diversity experts

被引:0
作者
Wang, Yifan [1 ]
Zhang, Fan [1 ]
Zhao, Qihao [2 ]
Hu, Wei [1 ]
Ma, Fei [1 ]
机构
[1] Beijing Univ Chem Technol, Beijing, Peoples R China
[2] Singapore Univ Technol & Design, Singapore, Singapore
基金
中国国家自然科学基金;
关键词
Long-tail distribution; Remote sensing; Diversity experts; Data augmentation; Foundation models; CLASS IMBALANCE; TRANSFORMER;
D O I
10.1016/j.jag.2025.104623
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Long-tailed class distributions pose a significant challenge in remote sensing scene recognition, where certain scene categories appear far less frequently than others. However, existing long-tailed learning approaches often overlook the unique spatial hierarchies and contextual semantic relationships inherent in remote sensing imagery, limiting their effectiveness in this domain. To address this, we propose Diversity-Mix Remote Sensing (DMRS), a foundation model-based framework designed for long-tailed remote sensing scene recognition. DMRS introduces two key innovations: (1) multi-low-rank adaptation diversity experts, which achieves balanced classification by specializing different experts for different regions of the class distribution, and (2) a semantic-aware mixing strategy, which incorporates textual semantic information typically unused in traditional classification to enhance perception across diverse remote sensing scenes. Extensive experiments on NWPU-RESISC45 and RSD46-WHU datasets demonstrate the effectiveness of DMRS, achieving 6.7% and 2.0% improvements in overall accuracy, respectively, while significantly enhancing the recognition of tail classes. These results highlight the potential of DMRS in tackling long-tail challenges in remote sensing scene classification. The data and codes used in the study are detailed in: https://github.com/wyfhbb/DMRS.
引用
收藏
页数:13
相关论文
共 71 条
[1]  
[毕辉 Bi Hui], 2022, [雷达学报, Journal of Radars], V11, P40
[2]   A systematic study of the class imbalance problem in convolutional neural networks [J].
Buda, Mateusz ;
Maki, Atsuto ;
Mazurowski, Maciej A. .
NEURAL NETWORKS, 2018, 106 :249-259
[3]  
Byrd J, 2019, PR MACH LEARN RES, V97
[4]   ACE: Ally Complementary Experts for Solving Long-Tailed Recognition in One-Shot [J].
Cai, Jiarui ;
Wang, Yizhou ;
Hwang, Jenq-Neng .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :112-121
[5]  
Cao KD, 2019, ADV NEUR IN, V32
[6]   Remote Sensing Image Scene Classification: Benchmark and State of the Art [J].
Cheng, Gong ;
Han, Junwei ;
Lu, Xiaoqiang .
PROCEEDINGS OF THE IEEE, 2017, 105 (10) :1865-1883
[7]   Parametric Contrastive Learning [J].
Cui, Jiequan ;
Zhong, Zhisheng ;
Liu, Shu ;
Yu, Bei ;
Jia, Jiaya .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :695-704
[8]   Class-Balanced Loss Based on Effective Number of Samples [J].
Cui, Yin ;
Jia, Menglin ;
Lin, Tsung-Yi ;
Song, Yang ;
Belongie, Serge .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :9260-9269
[9]  
Cubuk ED, 2019, Arxiv, DOI [arXiv:1805.09501, 10.48550/arXiv.1805.09501, DOI 10.1109/CVPR.2019.00020]
[10]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848