Label Semantic Dynamic Guidance Network for Remote Sensing Image Scene Classification

被引:0
作者
Chai, Borui
Zhao, Tianming
Yang, Runou
Zhang, Nan
Tian, Tian
Tian, Jinwen
机构
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2025年 / 63卷
基金
中国国家自然科学基金;
关键词
Semantics; Remote sensing; Feature extraction; Scene classification; Vectors; Training; Data mining; Correlation; Measurement; Contrastive learning; dynamic soft label generation; label semantic information; label semantics; remote sensing image scene classification;
D O I
暂无
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The remote sensing image scene classification continues to face significant challenges due to high intraclass diversity and interclass similarity. Existing methods mainly use semantic associations between images to establish deep semantic associations between classes, ignoring the rich high-level semantic knowledge contained in the label text. This high-level information are especially valuable for distinguishing between confusing categories, as it enables the model to capture both similarity and distinctive features effectively. In this article, we introduce a novel approach that incorporates label semantic information and proposes a plug-and-play framework to guide classification model learning of intraclass and interclass relationships. Specifically, our framework includes a dynamic soft label module (DSLM), which uses textual semantics to facilitate classification model learning of interclass relationships via soft labels at the target level. In addition, we design a coarse-to-fine contrastive module (CFCM) to integrate textual semantics into contrastive learning, guiding the model in capturing intraclass and interclass relationships at the feature level. Our framework is compatible with both convolutional neural network (CNN)-based and vision transformer (ViT)-based classification architectures and is employed solely during training to minimize computational overhead. Experimental results on four datasets validate the effectiveness of our approach.
引用
收藏
页数:14
相关论文
共 56 条
[1]   Classification of Remote Sensing Images Using EfficientNet-B3 CNN Model With Attention [J].
Alhichri, Haikel ;
Alswayed, Asma S. ;
Bazi, Yakoub ;
Ammour, Nassim ;
Alajlan, Naif A. .
IEEE ACCESS, 2021, 9 :14078-14094
[2]   Vision Transformers for Remote Sensing Image Classification [J].
Bazi, Yakoub ;
Bashmal, Laila ;
Rahhal, Mohamad M. Al ;
Dayil, Reham Al ;
Ajlan, Naif Al .
REMOTE SENSING, 2021, 13 (03) :1-20
[3]   Vision Transformer With Contrastive Learning for Remote Sensing Image Scene Classification [J].
Bi, Meiqiao ;
Wang, Minghua ;
Li, Zhi ;
Hong, Danfeng .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 :738-749
[4]  
Brown Tom B., 2020, ADV NEURAL INFORM PR
[5]  
Cai JJ, 2024, Arxiv, DOI arXiv:2412.02531
[6]   Grad-CAM plus plus : Generalized Gradient-based Visual Explanations for Deep Convolutional Networks [J].
Chattopadhay, Aditya ;
Sarkar, Anirban ;
Howlader, Prantik ;
Balasubramanian, Vineeth N. .
2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, :839-847
[7]   Land-use scene classification using multi-scale completed local binary patterns [J].
Chen, Chen ;
Zhang, Baochang ;
Su, Hongjun ;
Li, Wei ;
Wang, Lu .
SIGNAL IMAGE AND VIDEO PROCESSING, 2016, 10 (04) :745-752
[8]   Scene Classification Based on Gray Level-Gradient Co-Occurrence Matrix in the Neighborhood of Interest Points [J].
Chen, Shuo ;
Wu, Chengdong ;
Chen, Dongyue ;
Tan, Wenjun .
2009 IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTING AND INTELLIGENT SYSTEMS, PROCEEDINGS, VOL 4, 2009, :482-485
[9]   Visformer: The Vision-friendly Transformer [J].
Chen, Zhengsu ;
Xie, Lingxi ;
Niu, Jianwei ;
Liu, Xuefeng ;
Wei, Longhui ;
Tian, Qi .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :569-578
[10]   When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs [J].
Cheng, Gong ;
Yang, Ceyuan ;
Yao, Xiwen ;
Guo, Lei ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (05) :2811-2821