MATNet: Multilevel attention-based transformers for change detection in remote sensing images

被引:0
|
作者
Zhang, Zhongyu [1 ]
Liu, Shujun [2 ]
Qin, Yingxiang [3 ]
Wang, Huajun [4 ]
机构
[1] Chengdu Univ Technol, State Key Lab Geohazard Prevent & Geoenvironm Prot, Chengdu 610059, Peoples R China
[2] Chengdu Univ Technol, Minist Educ, Key Lab Earth Explorat & Infomat Tech, Chengdu 610059, Peoples R China
[3] Chengdu Univ Technol, Coll Geog & Planning, Chengdu 610059, Peoples R China
[4] Chengdu Univ Technol, Coll Math & Phys, Chengdu 610059, Peoples R China
关键词
Change detection; Attention mechanism; High-resolution (HR) optical image; Transformers; CLASSIFICATION; NETWORK;
D O I
10.1016/j.imavis.2024.105294
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Remote sensing image change detection is crucial for natural disaster monitoring and land use change. As the resolution increases, the scenes covered by remote sensing images become more complex, and traditional methods have difficulties in extracting detailed information. With the development of deep learning, the field of change detection has new opportunities. However, existing algorithms mainly focus on the difference analysis between bi-temporal images, while ignoring the semantic information between images, resulting in the global and local information not being able to interact effectively. In this paper, we introduce a new transformer-based multilevel attention network (MATNet), which is capable of extracting multilevel features of global and local information, enabling information interaction and fusion, and thus modeling the global context more effectively. Specifically, we extract multilevel semantic features through the Transformer encoder, and utilize the Feature Enhancement Module (FEM) to perform feature summing and differencing on the multilevel features in order to better extract the local detail information, and thus better detect the changes in small regions. In addition, we employ a multilevel attention decoder (MAD) to obtain information in spatial and spectral dimensions, which can effectively fuse global and local information. In experiments, our method performs excellently on CDD, DSIFNCD, LEVIR-CD, and SYSU-CD datasets, with F1 scores and OA reaching 95.67%/87.75%/90.94%/86.82% and 98.95%/95.93%/99.11%/90.53% respectively.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Multilevel Cloud Detection in Remote Sensing Images Based on Deep Learning
    Xie, Fengying
    Shi, Mengyun
    Shi, Zhenwei
    Yin, Jihao
    Zhao, Danpei
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2017, 10 (08) : 3631 - 3640
  • [22] FDA-FFNet: A Feature-Distance Attention-Based Change Detection Network for Remote Sensing Image
    Peng, Wenguang
    Shi, Wenzhong
    Zhang, Min
    Wang, Lukang
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 2224 - 2233
  • [23] Multiscale Attention Coupled With Adaptive Guidance for Change Detection With Remote Sensing Images
    Xu, Yang
    Lv, Zhiyong
    Zhong, Pingdong
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [24] GateFormer: Gate Attention UNet With Transformer for Change Detection of Remote Sensing Images
    Li, Li-Li
    You, Zhi-Hui
    Chen, Si-Bao
    Huang, Li-Li
    Tang, Jin
    Luo, Bin
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 871 - 883
  • [25] AMIO-Net: An Attention-Based Multiscale Input-Output Network for Building Change Detection in High-Resolution Remote Sensing Images
    Gao, Wei
    Sun, Yu
    Han, Xianwei
    Zhang, Yimin
    Zhang, Lei
    Hu, Yunliang
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 2079 - 2093
  • [26] MISGNet: A Multilevel Intertemporal Semantic Guidance Network for Remote Sensing Images Change Detection
    Cui, Binge
    Liu, Chenglong
    Li, Haojie
    Yu, Jianzhi
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 1827 - 1840
  • [27] Remote Sensing Target Detection Based on Multilevel Self- Attention Enhancement
    Wei Xiegen
    Cao Lin
    Tian Shu
    Du Kangning
    Song Peiran
    Guo Yanan
    LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (20)
  • [28] CHANGE DETECTION AND DYNAMIC ANALYSIS BASED ON REMOTE SENSING IMAGES
    Luzi, G.
    Crosetto, M.
    Devanthery, N.
    Cuevas, M.
    Meng, X.
    3RD ISPRS IWIDF 2013, 2013, 40-7-W1 : 185 - 188
  • [29] Aircraft detection in remote sensing images based on deconvolution and position attention
    Shi, Lukui
    Tang, Zhenjie
    Wang, Tiantian
    Xu, Xia
    Liu, Jing
    Zhang, Jun
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2021, 42 (11) : 4241 - 4260
  • [30] Attention-based feature pyramid networks for ship detection of optical remote sensing image
    Yu Y.
    Ai H.
    He X.
    Yu S.
    Zhong X.
    Zhu R.
    Yaogan Xuebao/Journal of Remote Sensing, 2020, 24 (02): : 107 - 115