Class-Incremental Novel Category Discovery in Remote Sensing Image Scene Classification via Contrastive Learning

被引:0
作者
Zhou, Yifan [1 ]
Zhu, Haoran [1 ]
Xu, Chang [1 ]
Zhang, Ruixiang [1 ]
Hua, Guang [2 ]
Yang, Wen [1 ]
机构
[1] Wuhan Univ, Sch Elect Informat, Wuhan 430072, Peoples R China
[2] Singapore Inst Technol, Infocomm Technol Cluster, Singapore 138683, Singapore
基金
中国国家自然科学基金;
关键词
Self-supervised learning; Task analysis; Training; Feature extraction; Scene classification; Data models; Pipelines; Contrastive learning; incremental learning; novel category discovery (NCD); remote sensing (RS); scene classification; NETWORK;
D O I
10.1109/JSTARS.2024.3391512
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote sensing (RS) imagery captures the earth's ever-changing landscapes, reflecting evolving land cover patterns propelled by natural processes and human activities. However, existing RS scene classification methods mainly operate under a closed-set hypothesis, which stumbles when encountering novel emerging scenes. This article addresses the intricate task of RS scene classification without labels for novel scenes under incremental learning, termed class-incremental novel category discovery. We propose a contrastive learning-based novel category discovery pipeline tailored for RS image scene classification, enhancing the ability to learn unlabeled novel class data. Furthermore, within this pipeline, we introduce a positive pair filter to identify more positive sample pairs from novel classes, improving the feature representation capability on unlabeled data. Besides, our contrastive learning pipeline incorporates an old-feature replaying method to alleviate catastrophic forgetting in old classes. Extensive evaluations across three public RS datasets showcase the superiority of our method over state-of-the-art approaches.
引用
收藏
页码:9214 / 9225
页数:12
相关论文
共 60 条
[2]  
Balestriero R, 2023, Arxiv, DOI [arXiv:2304.12210, DOI 10.48550/ARXIV.2304.12210]
[3]   Vision Transformer With Contrastive Learning for Remote Sensing Image Scene Classification [J].
Bi, Meiqiao ;
Wang, Minghua ;
Li, Zhi ;
Hong, Danfeng .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 :738-749
[4]  
Bordes F, 2022, Arxiv, DOI arXiv:2206.13378
[5]  
Buzzega Pietro, 2020, NeurIPS, P15920
[6]  
Caron M, 2020, ADV NEUR IN, V33
[7]   Emerging Properties in Self-Supervised Vision Transformers [J].
Caron, Mathilde ;
Touvron, Hugo ;
Misra, Ishan ;
Jegou, Herve ;
Mairal, Julien ;
Bojanowski, Piotr ;
Joulin, Armand .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :9630-9640
[8]   Remote Sensing Scene Classification via Multi-Branch Local Attention Network [J].
Chen, Si-Bao ;
Wei, Qing-Song ;
Wang, Wen-Zhong ;
Tang, Jin ;
Luo, Bin ;
Wang, Zu-Yuan .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :99-109
[9]  
Chen T, 2020, PR MACH LEARN RES, V119
[10]   Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities [J].
Cheng, Gong ;
Xie, Xingxing ;
Han, Junwei ;
Guo, Lei ;
Xia, Gui-Song .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :3735-3756