CGMMA: CNN-GNN Multiscale Mixed Attention Network for Remote Sensing Image Change Detection

被引:2
作者
Zhang, Yan [1 ]
Song, Xinyang [1 ]
Hua, Zhen [2 ]
Li, Jinjiang [1 ]
机构
[1] Shandong Technol & Business Univ, Inst Network Technol ICT, Sch Informat & Elect Engn, Yantai 264005, Peoples R China
[2] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264005, Peoples R China
基金
中国国家自然科学基金;
关键词
Attention mechanism; convolutional neural network (CNN); graph convolution; remote sensing change detection (CD); transformer; FUSION; GCN;
D O I
10.1109/JSTARS.2024.3358298
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Remote sensing change detection (CD) networks have been increasingly powerful with the application of convolutional neural networks (CNNs) and transformers. The CNN-based CD method with a CNN backbone has been widely used and plays an significant role. In complex spatial relationships within remote sensing images, CNNs may face limitations due to the restricted receptive field, making it challenging to handle intricate pixel relationships effectively. Therefore, to address this limitation of CNNs, we introduce vision graph neural network (ViG) to tackle the constrained receptive field issue. In addition, we propose a backbone network named Congraph, which integrates convolution and graph interaction. Congraph simultaneously leverages local information from CNNs and global information from GNNs, enabling more comprehensive feature extraction for more accurate change detection. Furthermore, we introduce a multiscale mixed attention (MMA) module to make the model focus on different scale feature information. MMA replaces small-scale features in the multilayer encoder with self-attention to capture global feature information within small-scale features. Finally, we feed bitemporal features into a transformer module to obtain feature difference information and generate the ultimate feature difference map. Through extensive experiments on the LEVIR-CD, WHU-CD, and GZ-CD datasets, our method demonstrates more significant performance advantages compared to the current state-of-the-art change detection methods.
引用
收藏
页码:7089 / 7103
页数:15
相关论文
共 52 条
[1]   A TRANSFORMER-BASED SIAMESE NETWORK FOR CHANGE DETECTION [J].
Bandara, Wele Gedara Chaminda ;
Patel, Vishal M. .
2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, :207-210
[2]   DO-Conv: Depthwise Over-Parameterized Convolutional Layer [J].
Cao, Jinming ;
Li, Yangyan ;
Sun, Mingchao ;
Chen, Ying ;
Lischinski, Dani ;
Cohen-Or, Daniel ;
Chen, Baoquan ;
Tu, Changhe .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :3726-3736
[3]   Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and k-Means Clustering [J].
Celik, Turgay .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2009, 6 (04) :772-776
[4]   Remote Sensing Image Change Detection With Transformers [J].
Chen, Hao ;
Qi, Zipeng ;
Shi, Zhenwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[5]   A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection [J].
Chen, Hao ;
Shi, Zhenwei .
REMOTE SENSING, 2020, 12 (10)
[6]  
Chen HRX, 2024, Arxiv, DOI arXiv:2310.02674
[7]   Exchange means change: An unsupervised single-temporal change detection framework based on intra- and inter-image patch exchange [J].
Chen, Hongruixuan ;
Song, Jian ;
Wu, Chen ;
Du, Bo ;
Yokoya, Naoto .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 206 :87-105
[8]   DASNet: Dual Attentive Fully Convolutional Siamese Networks for Change Detection in High-Resolution Satellite Images [J].
Chen, Jie ;
Yuan, Ziyang ;
Peng, Jian ;
Chen, Li ;
Huang, Haozhe ;
Zhu, Jiawei ;
Liu, Yu ;
Li, Haifeng .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :1194-1206
[9]   GCN-BASED SEMANTIC SEGMENTATION METHOD FOR MINE INFORMATION EXTRACTION IN GAOFEN-1 IMAGERY [J].
Liang, Chenbin ;
Xiao, Baihua ;
Cheng, Bo .
2021 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM IGARSS, 2021, :3432-3435
[10]   A hierarchical self-attention augmented Laplacian pyramid expanding network for change detection in high-resolution remote sensing images [J].
Cheng, Hongquan ;
Wu, Huayi ;
Zheng, Jie ;
Qi, Kunlun ;
Liu, Wenxuan .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2021, 182 :52-66