Attention-Based Multiscale Residual Adaptation Network for Cross-Scene Classification

被引:49
作者
Zhu, Sihan [1 ]
Du, Bo [2 ,3 ]
Zhang, Liangpei [1 ]
Li, Xue [1 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430079, Peoples R China
[2] Wuhan Univ, Inst Artificial Intelligence, Sch Comp Sci, Natl Engn Res Ctr Multimedia Software, Wuhan 430079, Peoples R China
[3] Wuhan Univ, Hubei Key Lab Multimedia & Network Commun Engn, Wuhan 430079, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2022年 / 60卷
基金
中国国家自然科学基金;
关键词
Feature extraction; Task analysis; Data mining; Adaptation models; Transfer learning; Periodic structures; Manifolds; Attention mechanism; cross-scene classification; deep domain adaptation; multiscale feature extraction; remote sensing (RS); residual learning; DOMAIN ADAPTATION; FRAMEWORK; KERNEL;
D O I
10.1109/TGRS.2021.3056624
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
In recent years, classification has obtained ever-rising attention and has been applied to many areas in the field of remote sensing, including land use, forest monitoring, urban planning, and vegetation management. Due to the lack of labeled data and the poor generalization ability of supervised models, cross-scene classification is proposed for better utilization of the existing knowledge. Existing adaptation methods for cross-scene classification only consider the marginal distribution, while the conditional distribution is equally important in real applications. In addition, approaches based on deep learning align the distribution of features extracted from a single-scale structure, leading to the loss of information. To overcome the above drawbacks, an Attention-based Multiscale Residual Adaptation Network (AMRAN) is proposed for cross-scene classification tasks. In the proposed AMRAN, both the marginal and conditional distributions are taken into consideration for more comprehensive alignment. Besides, the attention mechanism and the multiscale strategy are used to extract more robust features and more complete information, respectively. Experimental results between four existing scene classification data sets demonstrate that AMRAN has a significant improvement compared with the state-of-the-art deep adaptation methods.
引用
收藏
页数:15
相关论文
共 65 条
[1]  
[Anonymous], 2010, SIGSPATIAL GIS, DOI DOI 10.1145/1869790.1869829
[2]  
[Anonymous], 2014, CORR
[3]   A Novel Domain Adaptation Bayesian Classifier for Updating Land-Cover Maps With Class Differences in Source and Target Domains [J].
Bahirat, Kanchan ;
Bovolo, Francesca ;
Bruzzone, Lorenzo ;
Chaudhuri, Subhasis .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2012, 50 (07) :2810-2826
[4]  
Bashmal L, 2018, INT GEOSCI REMOTE SE, P4752, DOI 10.1109/IGARSS.2018.8517487
[5]   A theory of learning from different domains [J].
Ben-David, Shai ;
Blitzer, John ;
Crammer, Koby ;
Kulesza, Alex ;
Pereira, Fernando ;
Vaughan, Jennifer Wortman .
MACHINE LEARNING, 2010, 79 (1-2) :151-175
[6]  
Blitzer John, 2006, P 2006 C EMP METH NA, P120, DOI DOI 10.3115/1610075.1610094
[7]   Domain Adaptation Problems: A DASVM Classification Technique and a Circular Validation Strategy [J].
Bruzzone, Lorenzo ;
Marconcini, Mattia .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2010, 32 (05) :770-787
[8]  
Donahue J, 2014, PR MACH LEARN RES, V32
[9]   Multi-modal deep learning for landform recognition [J].
Du, Lin ;
You, Xiong ;
Li, Ke ;
Meng, Liqiu ;
Cheng, Gong ;
Xiong, Liyang ;
Wang, Guangxia .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2019, 158 :63-75
[10]   Unsupervised Visual Domain Adaptation Using Subspace Alignment [J].
Fernando, Basura ;
Habrard, Amaury ;
Sebban, Marc ;
Tuytelaars, Tinne .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :2960-2967