Class incremental learning of remote sensing images based on class similarity distillation

被引:3
作者
Shen, Mingge [1 ,2 ]
Chen, Dehu [3 ,4 ]
Hu, Silan [5 ]
Xu, Gang [1 ,2 ]
机构
[1] Zhejiang Coll Secur Technol, Coll Intelligent Equipment, Wenzhou, Zhejiang, Peoples R China
[2] Zhejiang Coll Secur Technol, Wenzhou Key Lab Stereoscop & Intelligent Monitorin, Wenzhou, Zhejiang, Peoples R China
[3] Wenzhou Univ Technol, Coll Architecture & Energy Engn, Wenzhou, Zhejiang, Peoples R China
[4] Wenzhou Univ Technol, Wenzhou Key Lab Intelligent Lifeline Protect & Eme, Wenzhou, Zhejiang, Peoples R China
[5] Macau Univ Sci & Technol, Fac Innovat Engn, Taipa, Macao, Peoples R China
关键词
Class incremental learning; Class similarity distillation; Global similarity distillation; Catastrophic forgetting; Remote sensing;
D O I
10.7717/peerj-cs.1583
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
When a well-trained model learns a new class, the data distribution differences between the new and old classes inevitably cause catastrophic forgetting in order to perform better in the new class. This behavior differs from human learning. In this article, we propose a class incremental object detection method for remote sensing images to address the problem of catastrophic forgetting caused by distribution differences among different classes. First, we introduce a class similarity distillation (CSD) loss based on the similarity between new and old class prototypes, ensuring the model's plasticity to learn new classes and stability to detect old classes. Second, to better extract class similarity features, we propose a global similarity distillation (GSD) loss that maximizes the mutual information between the new class feature and old class features. Additionally, we present a region proposal network (RPN)-based method that assigns positive and negative labels to prevent mislearning issues. Experiments demonstrate that our method is more accurate for class incremental learning on public DOTA and DIOR datasets and significantly improves training efficiency compared to state-of-theart class incremental object detection methods.
引用
收藏
页数:19
相关论文
共 56 条
[1]  
Rusu AA, 2016, Arxiv, DOI arXiv:1606.04671
[2]  
Ahn H, 2019, Arxiv, DOI arXiv:1905.11614
[3]   Task-Free Continual Learning [J].
Aljundi, Rahaf ;
Kelchtermans, Klaas ;
Tuytelaars, Tinne .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11246-11255
[4]   Memory Aware Synapses: Learning What (not) to Forget [J].
Aljundi, Rahaf ;
Babiloni, Francesca ;
Elhoseiny, Mohamed ;
Rohrbach, Marcus ;
Tuytelaars, Tinne .
COMPUTER VISION - ECCV 2018, PT III, 2018, 11207 :144-161
[5]   Expert Gate: Lifelong Learning with a Network of Experts [J].
Aljundi, Rahaf ;
Chakravarty, Punarjay ;
Tuytelaars, Tinne .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :7120-7129
[6]   Incremental Detection of Remote Sensing Objects With Feature Pyramid and Knowledge Distillation [J].
Chen, Jingzhou ;
Wang, Shihao ;
Chen, Ling ;
Cai, Haibin ;
Qian, Yuntao .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[7]  
De Lange M., 2021, P IEEE CVF INT C COM, P8250
[8]  
Dong N, 2021, ADV NEUR IN, V34
[9]   Small object detection in remote sensing images based on super-resolution [J].
Fang Xiaolin ;
Hu Fan ;
Yang Ming ;
Zhu Tongxin ;
Bi Ran ;
Zhang Zenghui ;
Gao Zhiyuan .
PATTERN RECOGNITION LETTERS, 2022, 153 :107-112
[10]   Double Similarity Distillation for Semantic Image Segmentation [J].
Feng, Yingchao ;
Sun, Xian ;
Diao, Wenhui ;
Li, Jihao ;
Gao, Xin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :5363-5376