HMCNet: Hybrid Efficient Remote Sensing Images Change Detection Network Based on Cross-Axis Attention MLP and CNN

被引:23
作者
Wang, Liejun [1 ]
Li, Haojin [1 ]
机构
[1] Xinjiang Univ, Coll Informat Sci & Engn, Urumqi 830046, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2022年 / 60卷
基金
美国国家科学基金会;
关键词
Feature extraction; Transformers; Computational modeling; Task analysis; Convolution; Computer vision; Remote sensing; Change detection (CD); cross-axis attention; hybrid model; multilayer perceptron (MLP); remote sensing (RS) images; COVER CHANGE;
D O I
10.1109/TGRS.2022.3215244
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
As an important task in the field of remote sensing image interpretation, change detection (CD) has been extensively studied by scholars in recent years. Affected by the illumination and the environment during bitemporal images' acquisition, there will be many pseudochanges, and the pseudochanges will seriously affect the effect of CD. Based on this, we propose a CD model named HMCNet, which introduces multilayer perceptron (MLP) into a convolutional neural network (CNN)-based CD model to form an MLP-CNN hybrid model. HMCNet has both the good feature extraction of CNN and the long-term dependence modeling ability of MLP, which can effectively overcome the interference of pseudochanges. In addition, the proposed cross-axis attention MLP can induce window attention of local features through shifted windows and, at the same time, form global attention to features through the interaction between information flows on the cross-axis, which effectively improves the comprehensive performance of MLP block. Extensive experiments on three public benchmark datasets show that HMCNet can achieve better performance with fewer parameters and Flops, and still maintain good generalization ability with fewer train data.
引用
收藏
页数:14
相关论文
共 47 条
[1]   Street-view change detection with deconvolutional networks [J].
Alcantarilla, Pablo F. ;
Stent, Simon ;
Ros, German ;
Arroyo, Roberto ;
Gherardi, Riccardo .
AUTONOMOUS ROBOTS, 2018, 42 (07) :1301-1322
[2]   Semantic Unsupervised Change Detection of Natural Land Cover With Multitemporal Object-Based Analysis on SAR Images [J].
Amitrano, Donato ;
Guida, Raffaella ;
Iervolino, Pasquale .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (07) :5494-5514
[3]  
Bandara WGC, 2022, Arxiv, DOI arXiv:2201.01293
[4]   Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and k-Means Clustering [J].
Celik, Turgay .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2009, 6 (04) :772-776
[5]   Remote Sensing Image Change Detection With Transformers [J].
Chen, Hao ;
Qi, Zipeng ;
Shi, Zhenwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[6]   A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection [J].
Chen, Hao ;
Shi, Zhenwei .
REMOTE SENSING, 2020, 12 (10)
[7]   DASNet: Dual Attentive Fully Convolutional Siamese Networks for Change Detection in High-Resolution Satellite Images [J].
Chen, Jie ;
Yuan, Ziyang ;
Peng, Jian ;
Chen, Li ;
Huang, Haozhe ;
Zhu, Jiawei ;
Liu, Yu ;
Li, Haifeng .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :1194-1206
[8]   Change Vector Analysis in Posterior Probability Space: A New Method for Land Cover Change Detection [J].
Chen, Jin ;
Chen, Xuehong ;
Cui, Xihong ;
Chen, Jun .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2011, 8 (02) :317-321
[9]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[10]  
Chen SF, 2022, Arxiv, DOI [arXiv:2107.10224, DOI 10.1109/TPAMI.2023.3303397]