FROM COARSE TO FINE: KNOWLEDGE DISTILLATION FOR REMOTE SENSING SCENE CLASSIFICATION

被引:1
作者
Ji, Jinsheng [1 ]
Xi, Xiaoming [2 ]
Lu, Xiankai [3 ]
Guo, Yiyou [4 ]
Xie, Huan [4 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore, Singapore
[2] Shandong Jianzhu Univ, Sch Comp Sci & Technol, Jinan 250101, Peoples R China
[3] Shandong Univ, Sch Software, Jinan 250101, Peoples R China
[4] Tongji Univ, Coll Surveying & Geo informat, Shanghai 200092, Peoples R China
来源
IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM | 2023年
关键词
Knowledge distillation; Scene classification; Coarse to fine; Remote sensing; NETWORK;
D O I
10.1109/IGARSS52108.2023.10282366
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Scene classification is one of the most commonly studied areas of parsing the earth observation data. How to effectively interpreting the remote sensing images and extracting informative features are the great challenges for remote sensing image classification. Many important applications, such as land management and urban analysis, are based on the performance of remote sensing classification model. Recently, a lot of CNN based methods have been proposed and achieve promising results. Inspired by the success of knowledge distillation which transfers the learned information from a teacher model to a student model, a knowledge distillation based framework is proposed in this paper to handle the task of remote sensing scene classification from coarse to fine. Specifically, the learned knowledge from the teacher network is transformed into the coarse soft label and fine output mask to better guiding the student network to learn more informative features. Experiments are conducted on two widely used remote sensing scene datasets to evaluate the effectiveness of the proposed method and achieve comparable results compared with some state-of-the-art methods.
引用
收藏
页码:5427 / 5430
页数:4
相关论文
共 12 条
[1]   Self-Attention-Based Deep Feature Fusion for Remote Sensing Scene Classification [J].
Cao, Ran ;
Fang, Leyuan ;
Lu, Ting ;
He, Nanjun .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (01) :43-47
[2]   Remote Sensing Image Scene Classification: Benchmark and State of the Art [J].
Cheng, Gong ;
Han, Junwei ;
Lu, Xiaoqiang .
PROCEEDINGS OF THE IEEE, 2017, 105 (10) :1865-1883
[3]  
He K, 2016, Proceedings of the IEEE conference on computer vision and pattern recognition, DOI [DOI 10.1109/CVPR.2016.90, 10.1109/CVPR.2016.90]
[4]   Classification of High-Spatial-Resolution Remote Sensing Scenes Method Using Transfer Learning and Deep Convolutional Neural Network [J].
Li, Wenmei ;
Wang, Ziteng ;
Wang, Yu ;
Wu, Jiaqi ;
Wang, Juan ;
Jia, Yan ;
Gui, Guan .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :1986-1995
[5]   A Feature Aggregation Convolutional Neural Network for Remote Sensing Scene Classification [J].
Lu, Xiaoqiang ;
Sun, Hao ;
Zheng, Xiangtao .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (10) :7894-7906
[6]   Remote Sensing Scene Image Classification Based on Self-Compensating Convolution Neural Network [J].
Shi, Cuiping ;
Zhang, Xinlei ;
Sun, Jingwei ;
Wang, Liguo .
REMOTE SENSING, 2022, 14 (03)
[7]   Branch Feature Fusion Convolution Network for Remote Sensing Scene Classification [J].
Shi, Cuiping ;
Wang, Tao ;
Wang, Liguo .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :5194-5210
[8]  
Skidmore A. K., 1997, ITC Journal, P302
[9]  
SZEGEDY C, 2016, PROC CVPR IEEE, P2818, DOI [DOI 10.1109/CVPR.2016.308, 10.1109/CVPR.2016.308]
[10]  
van der Maaten L, 2008, J MACH LEARN RES, V9, P2579