Remote Sensing Change Detection With Bitemporal and Differential Feature Interactive Perception

被引:4
作者
Chang, Hao [1 ,2 ,3 ,4 ]
Wang, Peijin [1 ,2 ]
Diao, Wenhui [1 ,2 ]
Xu, Guangluan [1 ,2 ]
Sun, Xian [1 ,2 ,3 ,4 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100190, Peoples R China
[2] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Network Informat Syst Technol NIST, Beijing 100190, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100190, Peoples R China
[4] Univ Chinese Acad Sci, Sch Elect Elect & Commun Engn, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Transformers; Semantics; Attention mechanisms; Correlation; Feature extraction; Costs; Computational modeling; Remote sensing; change detection; change of interest; semantic correlation; BUILDING CHANGE DETECTION; OBJECT DETECTION; FUSION NETWORK; IMAGE FUSION; CLASSIFICATION;
D O I
10.1109/TIP.2024.3424335
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, the transformer has achieved notable success in remote sensing (RS) change detection (CD). Its outstanding long-distance modeling ability can effectively recognize the change of interest (CoI). However, in order to obtain the precise pixel-level change regions, many methods directly integrate the stacked transformer blocks into the UNet-style structure, which causes the high computation costs. Besides, the existing methods generally consider bitemporal or differential features separately, which makes the utilization of ground semantic information still insufficient. In this paper, we propose the multiscale dual-space interactive perception network (MDIPNet) to fill these two gaps. On the one hand, we simplify the stacked multi-head transformer blocks into the single-layer single-head attention module and further introduce the lightweight parallel fusion module (LPFM) to perform the efficient information integration. On the other hand, based on the simplified attention mechanism, we propose the cross-space perception module (CSPM) to connect the bitemporal and differential feature spaces, which can help our model suppress the pseudo changes and mine the more abundant semantic consistency of CoI. Extensive experiment results on three challenging datasets and one urban expansion scene indicate that compared with the mainstream CD methods, our MDIPNet obtains the state-of-the-art (SOTA) performance while further controlling the computation costs.
引用
收藏
页码:4543 / 4555
页数:13
相关论文
共 66 条
[1]   A TRANSFORMER-BASED SIAMESE NETWORK FOR CHANGE DETECTION [J].
Bandara, Wele Gedara Chaminda ;
Patel, Vishal M. .
2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, :207-210
[2]  
Bandara WGC, 2024, Arxiv, DOI arXiv:2206.11892
[3]   A theoretical framework for unsupervised change detection based on change vector analysis in the polar domain [J].
Bovolo, Francesca ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2007, 45 (01) :218-236
[4]  
Carion Nicolas, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12346), P213, DOI 10.1007/978-3-030-58452-8_13
[5]  
Chang H., 2023, A Transformer-Based Network With Differential Feature Triple Refinement for Bitemporal Remote Sensing Image Change Detection
[6]   A Triple-Branch Hybrid Attention Network With Bitemporal Feature Joint Refinement for Remote-Sensing Image Semantic Change Detection [J].
Chang, Hao ;
Wang, Peijin ;
Diao, Wenhui ;
Xu, Guangluan ;
Sun, Xian .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 :1-16
[7]   Remote Sensing Image Change Detection With Transformers [J].
Chen, Hao ;
Qi, Zipeng ;
Shi, Zhenwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[8]   A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection [J].
Chen, Hao ;
Shi, Zhenwei .
REMOTE SENSING, 2020, 12 (10)
[9]   Land-use/land-cover change detection using improved change-vector analysis [J].
Chen, J ;
Gong, P ;
He, CY ;
Pu, RL ;
Shi, PJ .
PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2003, 69 (04) :369-379
[10]  
Cheng B, 2021, ADV NEUR IN, V34