Structural Attention Enhanced Continual Meta-Learning for Graph Edge Labeling Based Few-Shot Remote Sensing Scene Classification

被引:11
作者
Li, Feimo [1 ]
Li, Shuaibo [2 ]
Fan, Xinxin [3 ]
Li, Xiong [4 ]
Chang, Hongxing [1 ]
机构
[1] Chinese Acad Sci, Inst Automat, 95 Zhongguancun East Rd, Beijing 100190, Peoples R China
[2] Cent Univ Finance & Econ, Sch Informat, Shunsha Rd,Shahe Higher Educ Pk, Beijing 102206, Peoples R China
[3] Beihang Univ, Coll Software, 37 Xueyuan Rd, Beijing 100190, Peoples R China
[4] China Univ Min & Technol, Sch Mech Elect & Informat Engn, 11 Xueyuan Rd, Beijing 100083, Peoples R China
基金
中国国家自然科学基金;
关键词
remote sensing scene classification; few shot learning; continual meta-learning; graph transformer; NETWORK;
D O I
10.3390/rs14030485
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Scene classification is one of the fundamental techniques shared by many basic remote sensing tasks with a wide range of applications. As the demands of catering with situations under high variance in the data urgent conditions are rising, a research topic called few-shot scene classification is receiving more interest with a focus on building classification model from few training samples. Currently, methods using the meta-learning principle or graphical models are achieving state-of-art performances. However, there are still significant gaps in between the few-shot methods and the traditionally trained ones, as there are implicit data isolations in standard meta-learning procedure and less-flexibility in the static graph neural network modeling technique, which largely limit the data-to-knowledge transition efficiency. To address these issues, this paper proposed an novel few-shot scene classification algorithm based on a different meta-learning principle called continual meta-learning, which enhances the inter-task correlation by fusing more historical prior knowledge from a sequence of tasks within sections of meta-training or meta-testing periods. Moreover, as to increase the discriminative power between classes, a graph transformer is introduced to produce the structural attention, which can optimize the distribution of sample features in the embedded space and promotes the overall classification capability of the model. The advantages of our proposed algorithm are verified by comparing with nine state-of-art meta-learning based on few-shot scene classification on three popular datasets, where a minimum of a 9% increase in accuracy can be observed. Furthermore, the efficiency of the newly added modular modifications have also be verified by comparing to the continual meta-learning baseline.
引用
收藏
页数:31
相关论文
共 80 条
[1]   Bi-RDNet: Performance Enhancement for Remote Sensing Scene Classification with Rotational Duplicate Layers [J].
Akkul, Erdem Safa ;
Arican, Berk ;
Toreyin, Behcet Ugur .
ADVANCES IN COMPUTATIONAL COLLECTIVE INTELLIGENCE (ICCCI 2021), 2021, 1463 :669-678
[2]  
Alet F., 2020, P 8 INT C LEARNING R
[3]  
Alet F., 2018, P MACHINE LEARNING R
[4]  
Avtar, 2019, RESOURCES-BASEL, V8, DOI [DOI 10.3390/resources8030149, 10.3390/resources8030149]
[5]   Meta Learning via Learned Loss [J].
Bechtle, Sarah ;
Molchanov, Artem ;
Chebotar, Yevgen ;
Grefenstette, Edward ;
Righetti, Ludovic ;
Sukhatme, Gaurav ;
Meier, Franziska .
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, :4161-4168
[6]   Albumentations: Fast and Flexible Image Augmentations [J].
Buslaev, Alexander ;
Iglovikov, Vladimir I. ;
Khvedchenya, Eugene ;
Parinov, Alex ;
Druzhinin, Mikhail ;
Kalinin, Alexandr A. .
INFORMATION, 2020, 11 (02)
[7]  
Cai D, 2020, AAAI CONF ARTIF INTE, V34, P7464
[8]   Hierarchical Graph Neural Networks for Few-Shot Learning [J].
Chen, Cen ;
Li, Kenli ;
Wei, Wei ;
Zhou, Joey Tianyi ;
Zeng, Zeng .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (01) :240-252
[9]   Training Small Networks for Scene Classification of Remote Sensing Images via Knowledge Distillation [J].
Chen, Guanzhou ;
Zhang, Xiaodong ;
Tan, Xiaoliang ;
Cheng, Yufeng ;
Dai, Fan ;
Zhu, Kun ;
Gong, Yuanfu ;
Wang, Qing .
REMOTE SENSING, 2018, 10 (05)
[10]  
Chen JX, 2020, AAAI CONF ARTIF INTE, V34, P3478