CGMMA: CNN-GNN Multiscale Mixed Attention Network for Remote Sensing Image Change Detection

被引:2
作者
Zhang, Yan [1 ]
Song, Xinyang [1 ]
Hua, Zhen [2 ]
Li, Jinjiang [1 ]
机构
[1] Shandong Technol & Business Univ, Inst Network Technol ICT, Sch Informat & Elect Engn, Yantai 264005, Peoples R China
[2] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264005, Peoples R China
基金
中国国家自然科学基金;
关键词
Attention mechanism; convolutional neural network (CNN); graph convolution; remote sensing change detection (CD); transformer; FUSION; GCN;
D O I
10.1109/JSTARS.2024.3358298
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote sensing change detection (CD) networks have been increasingly powerful with the application of convolutional neural networks (CNNs) and transformers. The CNN-based CD method with a CNN backbone has been widely used and plays an significant role. In complex spatial relationships within remote sensing images, CNNs may face limitations due to the restricted receptive field, making it challenging to handle intricate pixel relationships effectively. Therefore, to address this limitation of CNNs, we introduce vision graph neural network (ViG) to tackle the constrained receptive field issue. In addition, we propose a backbone network named Congraph, which integrates convolution and graph interaction. Congraph simultaneously leverages local information from CNNs and global information from GNNs, enabling more comprehensive feature extraction for more accurate change detection. Furthermore, we introduce a multiscale mixed attention (MMA) module to make the model focus on different scale feature information. MMA replaces small-scale features in the multilayer encoder with self-attention to capture global feature information within small-scale features. Finally, we feed bitemporal features into a transformer module to obtain feature difference information and generate the ultimate feature difference map. Through extensive experiments on the LEVIR-CD, WHU-CD, and GZ-CD datasets, our method demonstrates more significant performance advantages compared to the current state-of-the-art change detection methods.
引用
收藏
页码:7089 / 7103
页数:15
相关论文
共 52 条
[21]   GCN-based multi-scale dual fusion for remote sensing building change detection [J].
Liang, Shike ;
Hua, Zhen ;
Li, Jinjiang .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (03) :953-980
[22]  
lino S., 2017, EarthResources Environmental Remote Sensing/GIS Applications VIII, P11
[23]   A CNN-Transformer Network With Multiscale Context Aggregation for Fine-Grained Cropland Change Detection [J].
Liu, Mengxi ;
Chai, Zhuoqun ;
Deng, Haojun ;
Liu, Rong .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 :4297-4306
[24]   CNN-Enhanced Graph Convolutional Network With Pixel- and Superpixel-Level Feature Fusion for Hyperspectral Image Classification [J].
Liu, Qichao ;
Xiao, Liang ;
Yang, Jingxiang ;
Wei, Zhihui .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (10) :8657-8671
[25]   Multimodal Ground-Based Remote Sensing Cloud Classification via Learning Heterogeneous Deep Features [J].
Liu, Shuang ;
Duan, Linlin ;
Zhang, Zhong ;
Cao, Xiaozhong ;
Durrani, Tariq S. .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (11) :7790-7800
[26]   An attention-based multiscale transformer network for remote sensing image change detection [J].
Liu, Wei ;
Lin, Yiyuan ;
Liu, Weijia ;
Yu, Yongtao ;
Li, Jonathan .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 202 :599-609
[27]   Building Change Detection for Remote Sensing Images Using a Dual-Task Constrained Deep Siamese Convolutional Network Model [J].
Liu, Yi ;
Pang, Chao ;
Zhan, Zongqian ;
Zhang, Xiaomeng ;
Yang, Xue .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (05) :811-815
[28]   Land cover characterization and change detection for environmental monitoring of pan-Europe [J].
Mücher, CA ;
Steinnocher, KT ;
Kressler, FP ;
Heunks, C .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2000, 21 (6-7) :1159-1181
[29]  
Oono K., 2020, P 8 INT C LEARN REPR, P1
[30]   Histogram thresholding for unsupervised change detection of remote sensing images [J].
Patra, Swarnajyoti ;
Ghosh, Susmita ;
Ghosh, Ashish .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2011, 32 (21) :6071-6089