A Class-Incremental Object Detection Method for Remote Sensing Images Based on Dynamic Multiprototype Matching

被引:0
作者
Hu, Mingtao [1 ,2 ,3 ,4 ]
Yin, Wenxin [1 ,2 ]
Diao, Wenhui [1 ,2 ]
Gao, Xin [1 ,2 ]
Sun, Xian [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100190, Peoples R China
[2] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Network Informat Syst Technol NIST, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100190, Peoples R China
[4] Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing 100190, Peoples R China
关键词
Prototypes; Object detection; Remote sensing; Incremental learning; Data models; Adaptation models; Training; Semantics; Computational modeling; Iron; Deep learning; incremental learning; object detection; remote sensing;
D O I
10.1109/JSTARS.2024.3520831
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In object detection task, incremental learning method enables the previously trained model better adapt to the new task using either a small amount of old data or none at all. In the incremental training processes of complex remote sensing scenes, the newly arrived data only includes new classes annotations. These new classes may exhibit spatial overlap and shape similarity with old classes or may have been labeled as background in earlier tasks, leading to a unique challenge called class semantic confusion. To address this issue, this article dynamically generate multiple representative prototypes of the different categories for refined matching the objects. To improve the matching accuracy, prototype contrastive learning is employed for expanding the distance between dissimilar prototypes and reducing the distance between similar prototypes. Meanwhile, a category perception enhancement module is proposed to enhance the aware of old categories to mitigate catastrophic forgetting. Comprehensive experimental results demonstrate that our proposed method outperforms the current state-of-the-art class-incremental object detection methods in most experimental settings on DIOR and FAIR1M datasets.
引用
收藏
页码:5157 / 5171
页数:15
相关论文
共 50 条
[41]   Object Detection in Remote Sensing Images based on One-class Classification [J].
Wang, Tian ;
Chen, Yang ;
Qiao, Meina ;
Zhu, Aichun ;
Wang, Ziyu ;
Snoussi, Hichem .
2017 CHINESE AUTOMATION CONGRESS (CAC), 2017, :6583-6587
[42]   Domain Generalized Object Detection for Remote Sensing Images [J].
Durakli, Efkan ;
Aptoula, Erchan .
2023 31ST SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU, 2023,
[43]   Detection in Optical Remote Sensing Images of Transmission Tower Based on Oriented Object Detection [J].
Tan, Yuanpeng ;
Jiao, Fei ;
Mo, Wenhao ;
Liu, Haiying ;
Bai, Xiaojing ;
Ma, Jiaxiu .
CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, 2025, 11 (01) :217-226
[44]   Addressing Sample Inconsistency for Semisupervised Object Detection in Remote Sensing Images [J].
Wang, Yuhao ;
Yao, Lifan ;
Meng, Gang ;
Zhang, Xinye ;
Song, Jiayun ;
Zhang, Haopeng .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 :6933-6944
[45]   Deep Learning and Machine Learning for Object Detection in Remote Sensing Images [J].
Yang, Guowei ;
Luo, Qiang ;
Yang, Yinding ;
Zhuang, Yin .
SIGNAL AND INFORMATION PROCESSING, NETWORKING AND COMPUTERS, 2018, 473 :249-256
[46]   Salient Object Detection in Optical Remote Sensing Images Driven by Transformer [J].
Li, Gongyang ;
Bai, Zhen ;
Liu, Zhi ;
Zhang, Xinpeng ;
Ling, Haibin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 :5257-5269
[47]   Bayesian Transfer Learning for Object Detection in Optical Remote Sensing Images [J].
Zhou, Changsheng ;
Zhang, Jiangshe ;
Liu, Junmin ;
Zhang, Chunxia ;
Shi, Guang ;
Hu, Junying .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (11) :7705-7719
[48]   A Hierarchical Context Embedding Network for Object Detection in Remote Sensing Images [J].
Zhang, Ke ;
Wu, Yulin ;
Wang, Jingyu ;
Wang, Qi .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[49]   Low-Rank Adaption on Transformer-Based Oriented Object Detector for Satellite Onboard Processing of Remote Sensing Images [J].
Pu, Xinyang ;
Xu, Feng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
[50]   Object Detection in Remote Sensing Images Based on Adaptive Multi-Scale Feature Fusion Method [J].
Liu, Chun ;
Zhang, Sixuan ;
Hu, Mengjie ;
Song, Qing .
REMOTE SENSING, 2024, 16 (05)