An Unsupervised Transformer-Based Multivariate Alteration Detection Approach for Change Detection in VHR Remote Sensing Images

被引:13
作者
Lin, Yizhang [1 ]
Liu, Sicong [1 ]
Zheng, Yongjie [1 ,2 ]
Tong, Xiaohua [1 ]
Xie, Huan [1 ]
Zhu, Hongming [3 ]
Du, Kecheng [1 ]
Zhao, Hui [1 ]
Zhang, Jie [1 ]
机构
[1] Tongji Univ, Coll Surveying & Geoinformat, Shanghai 200092, Peoples R China
[2] Univ Trento, Dept Informat Engn & Comp Sci, I-38123 Trento, Italy
[3] Tongji Univ, Sch Software Engn, Shanghai 201804, Peoples R China
基金
中国国家自然科学基金;
关键词
Change detection (CD); deep learning; iteratively reweighted multivariate alteration detection (IR-MAD); transformer; unsupervised; very-high-resolution (VHR) remote sensing images; CHANGE VECTOR ANALYSIS; SLOW FEATURE ANALYSIS; MAD;
D O I
10.1109/JSTARS.2024.3349775
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Multitemporal change detection (CD) plays a crucial role in the remote sensing application field. In recent years, supervised deep learning methods have shown excellent performance in detecting changes in very-high-resolution (VHR) images. However, these methods require a large number of labeled samples for training, making the process time-consuming and labor-intensive. Unsupervised approaches are more attractive in practical applications since they can produce a CD map without relying on any ground reference or prior knowledge. In this article, we propose a novel unsupervised CD approach, named transformer-based multivariate alteration detection (trans-MAD). It utilizes a pre-detection strategy that combines the compressed change vector analysis and the iteratively reweighted multivariate alteration detection (IR-MAD) to generate reliable pseudotraining samples. More accurate and robust CD results can be achieved by leveraging the IR-MAD to detect insignificant changes and by incorporating the transformer-based attention mechanism to model the difference or similarity between two distant pixels in an image. The proposed trans-MAD approach was validated on two VHR bitemporal satellite remote sensing datasets, and the obtained experimental results demonstrated its superiority comparing with the state-of-the-art unsupervised CD methods.
引用
收藏
页码:3251 / 3261
页数:11
相关论文
共 34 条
[1]   A Framework for Automatic and Unsupervised Detection of Multiple Changes in Multitemporal Images [J].
Bovolo, Francesca ;
Marchesi, Silvia ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2012, 50 (06) :2196-2212
[2]   Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and k-Means Clustering [J].
Celik, Turgay .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2009, 6 (04) :772-776
[3]   Remote Sensing Image Change Detection With Transformers [J].
Chen, Hao ;
Qi, Zipeng ;
Shi, Zhenwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[4]   Deep Siamese Multi-scale Convolutional Network for Change Detection in Multi-temporal VHR Images [J].
Chen, Hongruixuan ;
Wu, Chen ;
Du, Bo ;
Zhang, Liangpei .
2019 10TH INTERNATIONAL WORKSHOP ON THE ANALYSIS OF MULTITEMPORAL REMOTE SENSING IMAGES (MULTITEMP), 2019,
[5]  
Daudt RC, 2018, IEEE IMAGE PROC, P4063, DOI 10.1109/ICIP.2018.8451652
[6]   Unsupervised Deep Slow Feature Analysis for Change Detection in Multi-Temporal Remote Sensing Images [J].
Du, Bo ;
Ru, Lixiang ;
Wu, Chen ;
Zhang, Liangpei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (12) :9976-9992
[7]  
Feng Y., 2020, P IMAGE SIGNAL PROCE, P57
[8]   Generative Adversarial Networks for Change Detection in Multispectral Imagery [J].
Gong, Maoguo ;
Niu, Xudong ;
Zhang, Puzhao ;
Li, Zhetao .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (12) :2310-2314
[9]   Cross-city matters: A multimodal remote sensing benchmark dataset for cross-city semantic segmentation using high-resolution domain adaptation networks [J].
Hong, Danfeng ;
Zhang, Bing ;
Li, Hao ;
Li, Yuxuan ;
Yao, Jing ;
Li, Chenyu ;
Werner, Martin ;
Chanussot, Jocelyn ;
Zipf, Alexander ;
Zhu, Xiao Xiang .
REMOTE SENSING OF ENVIRONMENT, 2023, 299
[10]   More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification [J].
Hong, Danfeng ;
Gao, Lianru ;
Yokoya, Naoto ;
Yao, Jing ;
Chanussot, Jocelyn ;
Du, Qian ;
Zhang, Bing .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (05) :4340-4354