LHDACT: Lightweight Hybrid Dual Attention CNN and Transformer Network for Remote Sensing Image Change Detection

被引:5
作者
Song, Xinyang [1 ]
Hua, Zhen [2 ]
Li, Jinjiang [1 ]
机构
[1] Shandong Technol & Business Univ, Inst Network Technol ICT, Sch Informat & Elect Engn, Yantai 264005, Peoples R China
[2] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264005, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Convolution; Transformers; Task analysis; Dams; Convolutional neural networks; Computational modeling; Attention mechanism; change detection (CD); depthwise over-parameterized convolutional (Do-Conv); remote sensing (RS) images; transformer (TR);
D O I
10.1109/LGRS.2023.3323367
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
With the significant advancements of deep learning (DL) in the field of remote sensing (RS) imagery, a plethora of change detection (CD) methods based on CNNs, attention mechanisms, and transformers (TRs) have emerged. Presently, a substantial amount of research has gradually relinquished control over parameter quantities in pursuit of enhanced outcomes, resulting in the inflation of networks with numerous stacked modules. This letter is dedicated to integrating lightweight approaches into the CD task. We introduce a lightweight hybrid dual-attention CNN and TR (LHDACT) network based on depthwise over-parameterized convolutional (DO-Conv). In comparison to traditional convolution, DO-Conv combines both traditional and depthwise convolutions, achieving commendable performance enhancement with minimal additional cost. Furthermore, we leverage DO-Conv to enhance the multiscale average pooling (MSAP) module, ensuring global context with low computational overhead. To better discern regions of interest within complex images, we enhance the dual attention module (DAM) by sharing weights across spatial and channel dimensions, thereby bolstering feature region identification. At last, we employ a compact TR module to capture feature differences, enabling precise CD. Our approach is evaluated on the LEVIR-CD, WHU-CD, and GZ-CD datasets, yielding F1 scores of 91.23%, 87.51%, and 85.32%, respectively. These results demonstrate high performance on a cost-effective scale.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Remote Sensing Image Change Detection Transformer Network Based on Dual-Feature Mixed Attention
    Song, Xinyang
    Hua, Zhen
    Li, Jinjiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [2] Remote Sensing Image Change Detection Based on Lightweight Transformer and Multiscale Feature Fusion
    Li, Jingming
    Zheng, Panpan
    Wang, Liejun
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 5460 - 5473
  • [3] MixCDNet: A Lightweight Change Detection Network Mixing Features Across CNN and Transformer
    Wang, Linlin
    Zhang, Junping
    Bruzzone, Lorenzo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [4] SwinSUNet: Pure Transformer Network for Remote Sensing Image Change Detection
    Zhang, Cui
    Wang, Liejun
    Cheng, Shuli
    Li, Yongming
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [5] HMCNet: Hybrid Efficient Remote Sensing Images Change Detection Network Based on Cross-Axis Attention MLP and CNN
    Wang, Liejun
    Li, Haojin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [6] Asymmetric Cross-Attention Hierarchical Network Based on CNN and Transformer for Bitemporal Remote Sensing Images Change Detection
    Zhang, Xiaofeng
    Cheng, Shuli
    Wang, Liejun
    Li, Haojin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [7] CD-CTFM: A Lightweight CNN-Transformer Network for Remote Sensing Cloud Detection Fusing Multiscale Features
    Ge, Wenxuan
    Yang, Xubing
    Jiang, Rui
    Shao, Wei
    Zhang, Li
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 4538 - 4551
  • [8] STLNet: Symmetric Transformer Learning Network for Remote Sensing Image Change Detection
    Mei, Liye
    Huang, Andong
    Ye, Zhaoyi
    Yalikun, Yaxiaer
    Wang, Ying
    Xu, Chuan
    Yang, Wei
    Li, Xinghua
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 2655 - 2667
  • [9] A Lightweight Sparse Focus Transformer for Remote Sensing Image Change Captioning
    Sun, Dongwei
    Bao, Yajie
    Liu, Junmin
    Cao, Xiangyong
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 18727 - 18738
  • [10] Transformer With Feature Interaction and Fusion for Remote Sensing Image Change Detection
    Guo, Dongen
    Zou, Tao
    Xia, Ying
    Feng, Jiangfan
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 15407 - 15419