LHDACT: Lightweight Hybrid Dual Attention CNN and Transformer Network for Remote Sensing Image Change Detection

被引:5
|
作者
Song, Xinyang [1 ]
Hua, Zhen [2 ]
Li, Jinjiang [1 ]
机构
[1] Shandong Technol & Business Univ, Inst Network Technol ICT, Sch Informat & Elect Engn, Yantai 264005, Peoples R China
[2] Shandong Technol & Business Univ, Sch Comp Sci & Technol, Yantai 264005, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Convolution; Transformers; Task analysis; Dams; Convolutional neural networks; Computational modeling; Attention mechanism; change detection (CD); depthwise over-parameterized convolutional (Do-Conv); remote sensing (RS) images; transformer (TR);
D O I
10.1109/LGRS.2023.3323367
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
With the significant advancements of deep learning (DL) in the field of remote sensing (RS) imagery, a plethora of change detection (CD) methods based on CNNs, attention mechanisms, and transformers (TRs) have emerged. Presently, a substantial amount of research has gradually relinquished control over parameter quantities in pursuit of enhanced outcomes, resulting in the inflation of networks with numerous stacked modules. This letter is dedicated to integrating lightweight approaches into the CD task. We introduce a lightweight hybrid dual-attention CNN and TR (LHDACT) network based on depthwise over-parameterized convolutional (DO-Conv). In comparison to traditional convolution, DO-Conv combines both traditional and depthwise convolutions, achieving commendable performance enhancement with minimal additional cost. Furthermore, we leverage DO-Conv to enhance the multiscale average pooling (MSAP) module, ensuring global context with low computational overhead. To better discern regions of interest within complex images, we enhance the dual attention module (DAM) by sharing weights across spatial and channel dimensions, thereby bolstering feature region identification. At last, we employ a compact TR module to capture feature differences, enabling precise CD. Our approach is evaluated on the LEVIR-CD, WHU-CD, and GZ-CD datasets, yielding F1 scores of 91.23%, 87.51%, and 85.32%, respectively. These results demonstrate high performance on a cost-effective scale.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Enhanced hybrid CNN and transformer network for remote sensing image change detection
    Yang, Junjie
    Wan, Haibo
    Shang, Zhihai
    SCIENTIFIC REPORTS, 2025, 15 (01):
  • [2] TITAN: A LighTweIght Temporal Attention Network for Remote Sensing Image Change Detection
    Santos, Daniel F. S.
    Papa, Joao P.
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [3] Remote Sensing Image Change Detection Transformer Network Based on Dual-Feature Mixed Attention
    Song, Xinyang
    Hua, Zhen
    Li, Jinjiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] Lightweight Structure-Aware Transformer Network for Remote Sensing Image Change Detection
    Lei, Tao
    Xu, Yetong
    Ning, Hailong
    Lv, Zhiyong
    Min, Chongdan
    Jin, Yaochu
    Nandi, Asoke K.
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [5] An attention-based multiscale transformer network for remote sensing image change detection
    Liu, Wei
    Lin, Yiyuan
    Liu, Weijia
    Yu, Yongtao
    Li, Jonathan
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 202 : 599 - 609
  • [6] Remote sensing image change detection based on CNN-Transformer structure
    Pan, Mengyang
    Yang, Hang
    Fan, Xianghui
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2024, 39 (10) : 1361 - 1379
  • [7] A Full-Scale Connected CNN-Transformer Network for Remote Sensing Image Change Detection
    Chen, Min
    Zhang, Qiangjiang
    Ge, Xuming
    Xu, Bo
    Hu, Han
    Zhu, Qing
    Zhang, Xin
    REMOTE SENSING, 2023, 15 (22)
  • [8] DBCT-Net:A dual branch hybrid CNN-transformer network for remote sensing image fusion
    Wang, Quanli
    Jin, Xin
    Jiang, Qian
    Wu, Liwen
    Zhang, Yunchun
    Zhou, Wei
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 233
  • [9] Relating CNN-Transformer Fusion Network for Remote Sensing Change Detection
    Gao, Yuhao
    Pei, Gensheng
    Sheng, Mengmeng
    Sun, Zeren
    Chen, Tao
    Yao, Yazhou
    2024 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME 2024, 2024,
  • [10] A dual-branch and dual attention transformer and CNN hybrid network for ultrasound image segmentation
    Zhang, Chong
    Wang, Lingtong
    Wei, Guohui
    Kong, Zhiyong
    Qiu, Min
    FRONTIERS IN PHYSIOLOGY, 2024, 15