Relating CNN-Transformer Fusion Network for Remote Sensing Change Detection

被引:0
|
作者
Gao, Yuhao [1 ]
Pei, Gensheng [1 ]
Sheng, Mengmeng [1 ]
Sun, Zeren [1 ]
Chen, Tao [1 ]
Yao, Yazhou [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
Change Detection; Cross-Stage Aggregation; Multi-Scale Fusion; VISUAL RECOGNITION;
D O I
10.1109/ICME57554.2024.10687791
中图分类号
学科分类号
摘要
While deep learning, particularly convolutional neural networks (CNNs), has revolutionized remote sensing (RS) change detection (CD), existing approaches often miss crucial features due to neglecting global context and incomplete change learning. Additionally, transformer networks struggle with low-level details. RCTNet addresses these limitations by introducing (1) an early fusion backbone to exploit both spatial and temporal features early on, (2) a Cross-Stage Aggregation (CSA) module for enhanced temporal representation, (3) a Multi-Scale Feature Fusion (MSF) module for enriched feature extraction in the decoder, and (4) an Efficient Self-deciphering Attention (ESA) module utilizing transformers to capture global information and finegrained details for accurate change detection. Extensive experiments demonstrate RCTNet's clear superiority over traditional RS image CD methods, showing significant improvement and an optimal balance between accuracy and computational cost. Our source codes and pre-trained models are available at: https: //github.com/NUST- Machine- Intelligence-Laboratory/RCTNet.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] ConvTransNet: A CNN-Transformer Network for Change Detection With Multiscale Global-Local Representations
    Li, Weiming
    Xue, Lihui
    Wang, Xueqian
    Li, Gang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [22] ACTNet: A Dual-Attention Adapter with a CNN-Transformer Network for the Semantic Segmentation of Remote Sensing Imagery
    Zhang, Zheng
    Liu, Fanchen
    Liu, Changan
    Tian, Qing
    Qu, Hongquan
    REMOTE SENSING, 2023, 15 (09)
  • [23] Single-Image Superresolution for RGB Remote Sensing Imagery via Multiscale CNN-Transformer Feature Fusion
    Yao, Xudong
    Zhang, Haopeng
    Wen, Sizhe
    Shi, Zhenwei
    Jiang, Zhiguo
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 1302 - 1316
  • [24] LHDACT: Lightweight Hybrid Dual Attention CNN and Transformer Network for Remote Sensing Image Change Detection
    Song, Xinyang
    Hua, Zhen
    Li, Jinjiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [25] Hyperspectral Image Compression Sensing Network With CNN-Transformer Mixture Architectures
    Zhang, Lei
    Zhang, Longsheng
    Song, Chengpeng
    Zhang, Peng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [26] An Efficient Hybrid CNN-Transformer Approach for Remote Sensing Super-Resolution
    Zhang, Wenjian
    Tan, Zheng
    Lv, Qunbo
    Li, Jiaao
    Zhu, Baoyu
    Liu, Yangyang
    REMOTE SENSING, 2024, 16 (05)
  • [27] Remote Sensing Image Road Segmentation Method Integrating CNN-Transformer and UNet
    Wang, Rui
    Cai, Mingxiang
    Xia, Zixuan
    Zhou, Zhicui
    IEEE ACCESS, 2023, 11 : 144446 - 144455
  • [28] DiFormer: A Difference Transformer Network for Remote Sensing Change Detection
    Lin, Hui
    Hang, Renlong
    Wang, Shanmin
    Liu, Qingshan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [29] A CNN-Transformer Network With Multiscale Context Aggregation for Fine-Grained Cropland Change Detection
    Liu, Mengxi
    Chai, Zhuoqun
    Deng, Haojun
    Liu, Rong
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 4297 - 4306
  • [30] Transformer With Feature Interaction and Fusion for Remote Sensing Image Change Detection
    Guo, Dongen
    Zou, Tao
    Xia, Ying
    Feng, Jiangfan
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 15407 - 15419