Dynamic Convolution Self-Attention Network for Land-Cover Classification in VHR Remote-Sensing Images

被引:5
|
作者
Wang, Xuan [1 ]
Zhang, Yue [2 ,3 ]
Lei, Tao [2 ,3 ]
Wang, Yingbo [2 ,3 ]
Zhai, Yujie [2 ,3 ]
Nandi, Asoke K. [4 ,5 ]
机构
[1] Univ Wisconsin, Dept Elect & Comp Engn, 1415 Johnson Dr, Madison, WI 53706 USA
[2] Shaanxi Univ Sci & Technol, Shaanxi Joint Lab Artificial Intelligence, Xian 710021, Peoples R China
[3] Shaanxi Univ Sci & Technol, Sch Elect Informat & Artificial Intelligence, Xian 710021, Peoples R China
[4] Brunel Univ, Dept Elect & Elect Engn, London UB8 3PH, England
[5] Xi An Jiao Tong Univ, Sch Mech Engn, Xian 710049, Peoples R China
基金
中国国家自然科学基金;
关键词
land-cover classification; feature fusion; self-attention; lightweight; SEMANTIC SEGMENTATION; MULTISCALE; AGGREGATION; FUSION;
D O I
10.3390/rs14194941
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The current deep convolutional neural networks for very-high-resolution (VHR) remote-sensing image land-cover classification often suffer from two challenges. First, the feature maps extracted by network encoders based on vanilla convolution usually contain a lot of redundant information, which easily causes misclassification of land cover. Moreover, these encoders usually require a large number of parameters and high computational costs. Second, as remote-sensing images are complex and contain many objects with large-scale variances, it is difficult to use the popular feature fusion modules to improve the representation ability of networks. To address the above issues, we propose a dynamic convolution self-attention network (DCSA-Net) for VHR remote-sensing image land-cover classification. The proposed network has two advantages. On one hand, we designed a lightweight dynamic convolution module (LDCM) by using dynamic convolution and a self-attention mechanism. This module can extract more useful image features than vanilla convolution, avoiding the negative effect of useless feature maps on land-cover classification. On the other hand, we designed a context information aggregation module (CIAM) with a ladder structure to enlarge the receptive field. This module can aggregate multi-scale contexture information from feature maps with different resolutions using a dense connection. Experiment results show that the proposed DCSA-Net is superior to state-of-the-art networks due to higher accuracy of land-cover classification, fewer parameters, and lower computational cost. The source code is made public available.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Multi-Modality and Multi-Scale Attention Fusion Network for Land Cover Classification from VHR Remote Sensing Images
    Lei, Tao
    Li, Linze
    Lv, Zhiyong
    Zhu, Mingzhe
    Du, Xiaogang
    Nandi, Asoke K.
    REMOTE SENSING, 2021, 13 (18)
  • [2] Novel Land-Cover Classification Approach With Nonparametric Sample Augmentation for Hyperspectral Remote-Sensing Images
    Lv, Zhiyong
    Zhang, Pengfei
    Sun, Weiwei
    Benediktsson, Jon Atli
    Lei, Tao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [3] Cross-spatiotemporal land-cover classification from VHR remote sensing images with deep learning based domain adaptation
    Luo, Muying
    Ji, Shunping
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 191 : 105 - 128
  • [4] A Novel Network-Level Fusion Architecture of Proposed Self-Attention and Vision Transformer Models for Land Use and Land Cover Classification From Remote Sensing Images
    Rubab, Saddaf
    Khan, Muhammad Attique
    Hamza, Ameer
    Albarakati, Hussain Mobarak
    Saidani, Oumaima
    Alshardan, Amal
    Alasiry, Areej
    Marzougui, Mehrez
    Nam, Yunyoung
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 13135 - 13148
  • [5] SABNet: Self-Attention Bilateral Network for Land Cover Classification
    Hu, Zhehao
    Qian, Yurong
    Xiao, ZhengQing
    Yang, Guangqi
    Jiang, Hao
    Sun, Xiao
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 8559 - 8569
  • [6] Land Cover Classification From VHR Optical Remote Sensing Images by Feature Ensemble Deep Learning Network
    Dong, Shan
    Zhuang, Yin
    Yang, Zhanxin
    Pang, Long
    Chen, He
    Long, Teng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (08) : 1396 - 1400
  • [7] Hierarchical Self-Attention Embedded Neural Network With Dense Connection for Remote-Sensing Image Semantic Segmentation
    Li, Chunhua
    Li, Xin
    Xia, Runliang
    Li, Tao
    Lyu, Xin
    Tong, Yao
    Zhao, Liancheng
    Wang, Xinyuan
    IEEE ACCESS, 2021, 9 : 126623 - 126634
  • [8] Long-Range Correlation Supervision for Land-Cover Classification From Remote Sensing Images
    Yu, Dawen
    Ji, Shunping
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [9] A Novel Deep Learning Architecture for Agriculture Land Cover and Land Use Classification from Remote Sensing Images Based on Network-Level Fusion of Self-Attention Architecture
    Albarakati, Hussain Mobarak
    Khan, Muhammad Attique
    Hamza, Ameer
    Khan, Faheem
    Kraiem, Naoufel
    Jamel, Leila
    Almuqren, Latifah
    Alroobaea, Roobaea
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 6338 - 6353
  • [10] Mixing Self-Attention and Convolution: A Unified Framework for Multisource Remote Sensing Data Classification
    Li, Ke
    Wang, Di
    Wang, Xu
    Liu, Gang
    Wu, Zili
    Wang, Quan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61