CLASS-INCREMENTAL LEARNING FOR REMOTE SENSING IMAGES BASED ON KNOWLEDGE DISTILLATION

被引:2
作者
Song, Jingduo [1 ]
Jia, Hecheng [1 ]
Xu, Feng [1 ]
机构
[1] Fudan Univ, Key Lab Informat Sci Elect Waves, MoE, Shanghai 200433, Peoples R China
来源
IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM | 2023年
关键词
Class-incremental learning; remote sensing images; knowledge distillation; Pearson correlation coefficient;
D O I
10.1109/IGARSS52108.2023.10282758
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
In real-world recognition of remote sensing (RS) targets, large amount of RS data is hard to be acquired at once, but arrives in batches, which means the constantly adaption of models for new data and new classes. However, training old and new data together from scratch has certain requirements on data storage space and retraining time, so incremental learning come to be desirable for future RS recognition systems. In this article, a class incremental learning method based on knowledge distillation is proposed for RS image classification. In order to better retain the knowledge of old tasks, a relation-based loss is used as a new matching manner in distillation loss, which frees the student model from the burden of matching the exact output of the teacher model. Experiment results based on UC Merced 21, NWPU-RESISC45 and plane objects of FAIR1M demonstrate the advantages of the proposed method.
引用
收藏
页码:5026 / 5028
页数:3
相关论文
共 10 条
[1]   Remote Sensing Image Scene Classification: Benchmark and State of the Art [J].
Cheng, Gong ;
Han, Junwei ;
Lu, Xiaoqiang .
PROCEEDINGS OF THE IEEE, 2017, 105 (10) :1865-1883
[2]  
Hinton G., 2015, ARXIV
[3]  
Huang Tao, 2022, ARXIV220510536
[4]   Learning Without Forgetting [J].
Li, Zhizhong ;
Hoiem, Derek .
COMPUTER VISION - ECCV 2016, PT IV, 2016, 9908 :614-629
[5]   LIL: Lightweight Incremental Learning Approach Through Feature Transfer for Remote Sensing Image Scene Classification [J].
Lu, Xiaonan ;
Sun, Xian ;
Diao, Wenhui ;
Feng, Yingchao ;
Wang, Peijin ;
Fu, Kun .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[6]   Class-Incremental Learning: Survey and Performance Evaluation on Image Classification [J].
Masana, Marc ;
Liu, Xialei ;
Twardowski, Bartlomiej ;
Menta, Mikel ;
Bagdanov, Andrew D. ;
van de Weijer, Joost .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (05) :5513-5533
[7]   iCaRL: Incremental Classifier and Representation Learning [J].
Rebuffi, Sylvestre-Alvise ;
Kolesnikov, Alexander ;
Sperl, Georg ;
Lampert, Christoph H. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5533-5542
[8]   FAIR1M: A benchmark dataset for fine-grained object recognition in high-resolution remote sensing imagery [J].
Sun, Xian ;
Wang, Peijin ;
Yan, Zhiyuan ;
Xu, Feng ;
Wang, Ruiping ;
Diao, Wenhui ;
Chen, Jin ;
Li, Jihao ;
Feng, Yingchao ;
Xu, Tao ;
Weinmann, Martin ;
Hinz, Stefan ;
Wang, Cheng ;
Fu, Kun .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 184 :116-130
[9]   DER: Dynamically Expandable Representation for Class Incremental Learning [J].
Yan, Shipeng ;
Xie, Jiangwei ;
He, Xuming .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :3013-3022
[10]  
Yang Y., 2010, P 18 SIGSPATIAL INT, P270