A Semi-Supervised Domain Alignment Transformer for Hyperspectral Images Change Detection

被引:18
作者
Wang, Yanheng [1 ,2 ]
Sha, Jianjun [1 ,2 ]
Gao, Lianru [3 ]
Zhang, Yonggang [1 ]
Rong, Xianhui [2 ]
Zhang, Ce [4 ,5 ]
机构
[1] Harbin Engn Univ, Coll Intelligent Syst Sci & Engn, Harbin 150001, Peoples R China
[2] Harbin Engn Univ, Qingdao Innovat & Dev Base, Qingdao 266000, Peoples R China
[3] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[4] Univ Bristol, Sch Geog Sci, Bristol BS8 1SS, England
[5] UK Ctr Ecol & Hydrol, Lancaster LA1 4AP, England
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
关键词
Autoencoder; change detection (CD); domain alignment; hyperspectral images (HSIs); transformer; MAD;
D O I
10.1109/TGRS.2023.3317919
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Supervised deep learning (DL)-based hyperspectral images change detection (HSIs-CD) has demonstrated excellent performance; however, current methods require many labeled training samples, and labeling the dataset is labor-intensive, limiting the application of high-precision supervised learning. Besides, there has been a lack of breakthroughs in unsupervised HSIs change detection (CD) methods due to the different feature distributions of bitemporal HSIs. Here, we propose a semi-supervised domain alignment transformer (DA-Former) for HSIs-CD to address the issues with limited samples. Specifically, a dual-branch transformer autoencoder (TAE) is designed, where the middle layer weights of the dual-branch transformer are shared, pulling features from different data into the same space. Moreover, the TAE is also trained cyclically to align the domains. Although the bitemporal HSIs features are cross domain, there is still confusion between the features of different objects. Thus, two fully connected (FC) layers are employed to classify the HSIs middle features extracted by the TAE into changed class or unchanged class with limited labeled data. Three HSIs-CD datasets are used to test this method, showing that TAE can align bitemporal HSIs domains and achieve the highest accuracy compared with benchmark approaches.
引用
收藏
页数:11
相关论文
共 39 条
[1]   A Framework for Automatic and Unsupervised Detection of Multiple Changes in Multitemporal Images [J].
Bovolo, Francesca ;
Marchesi, Silvia ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2012, 50 (06) :2196-2212
[2]   Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and k-Means Clustering [J].
Celik, Turgay .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2009, 6 (04) :772-776
[3]   A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection [J].
Chen, Hao ;
Shi, Zhenwei .
REMOTE SENSING, 2020, 12 (10)
[4]   Unsupervised Deep Slow Feature Analysis for Change Detection in Multi-Temporal Remote Sensing Images [J].
Du, Bo ;
Ru, Lixiang ;
Wu, Chen ;
Zhang, Liangpei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (12) :9976-9992
[5]   An improved change detection approach using tri-temporal logic-verified change vector analysis [J].
Du, Peijun ;
Wang, Xin ;
Chen, Dongmei ;
Liu, Sicong ;
Lin, Cong ;
Meng, Yaping .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 161 :278-293
[6]   AutoNAS: Automatic Neural Architecture Search for Hyperspectral Unmixing [J].
Han, Zhu ;
Hong, Danfeng ;
Gao, Lianru ;
Zhang, Bing ;
Huang, Min ;
Chanussot, Jocelyn .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[7]   Multimodal Hyperspectral Unmixing: Insights From Attention Networks [J].
Han, Zhu ;
Hong, Danfeng ;
Gao, Lianru ;
Yao, Jing ;
Zhang, Bing ;
Chanussot, Jocelyn .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[8]   Deep Half-Siamese Networks for Hyperspectral Unmixing [J].
Han, Zhu ;
Hong, Danfeng ;
Gao, Lianru ;
Zhang, Bing ;
Chanussot, Jocelyn .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (11) :1996-2000
[9]   Hyperspectral change detection: an experimental comparative study [J].
Hasanlou, Mahdi ;
Seydi, Seyd Teymoor .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2018, 39 (20) :7029-7083
[10]   SpectralFormer: Rethinking Hyperspectral Image Classification With Transformers [J].
Hong, Danfeng ;
Han, Zhu ;
Yao, Jing ;
Gao, Lianru ;
Zhang, Bing ;
Plaza, Antonio ;
Chanussot, Jocelyn .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60