Dynamic Convolution Self-Attention Network for Land-Cover Classification in VHR Remote-Sensing Images

被引:5
|
作者
Wang, Xuan [1 ]
Zhang, Yue [2 ,3 ]
Lei, Tao [2 ,3 ]
Wang, Yingbo [2 ,3 ]
Zhai, Yujie [2 ,3 ]
Nandi, Asoke K. [4 ,5 ]
机构
[1] Univ Wisconsin, Dept Elect & Comp Engn, 1415 Johnson Dr, Madison, WI 53706 USA
[2] Shaanxi Univ Sci & Technol, Shaanxi Joint Lab Artificial Intelligence, Xian 710021, Peoples R China
[3] Shaanxi Univ Sci & Technol, Sch Elect Informat & Artificial Intelligence, Xian 710021, Peoples R China
[4] Brunel Univ, Dept Elect & Elect Engn, London UB8 3PH, England
[5] Xi An Jiao Tong Univ, Sch Mech Engn, Xian 710049, Peoples R China
基金
中国国家自然科学基金;
关键词
land-cover classification; feature fusion; self-attention; lightweight; SEMANTIC SEGMENTATION; MULTISCALE; AGGREGATION; FUSION;
D O I
10.3390/rs14194941
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The current deep convolutional neural networks for very-high-resolution (VHR) remote-sensing image land-cover classification often suffer from two challenges. First, the feature maps extracted by network encoders based on vanilla convolution usually contain a lot of redundant information, which easily causes misclassification of land cover. Moreover, these encoders usually require a large number of parameters and high computational costs. Second, as remote-sensing images are complex and contain many objects with large-scale variances, it is difficult to use the popular feature fusion modules to improve the representation ability of networks. To address the above issues, we propose a dynamic convolution self-attention network (DCSA-Net) for VHR remote-sensing image land-cover classification. The proposed network has two advantages. On one hand, we designed a lightweight dynamic convolution module (LDCM) by using dynamic convolution and a self-attention mechanism. This module can extract more useful image features than vanilla convolution, avoiding the negative effect of useless feature maps on land-cover classification. On the other hand, we designed a context information aggregation module (CIAM) with a ladder structure to enlarge the receptive field. This module can aggregate multi-scale contexture information from feature maps with different resolutions using a dense connection. Experiment results show that the proposed DCSA-Net is superior to state-of-the-art networks due to higher accuracy of land-cover classification, fewer parameters, and lower computational cost. The source code is made public available.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] SEMANTIC SEGMENTATION OF HIGH-RESOLUTION REMOTE SENSING IMAGES BASED ON SPARSE SELF-ATTENTION
    Sun, Li
    Zou, Huanxin
    Wei, Juan
    Li, Meilin
    Cao, Xu
    He, Shitian
    Liu, Shuo
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 3492 - 3495
  • [42] A self-attention dynamic graph convolution network model for traffic flow prediction
    Liao, Kaili
    Zhou, Wuneng
    Wu, Wanpeng
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2024,
  • [43] Land cover classification using multi-fusion based dense transpose convolution in fully convolutional network with feature alignment for remote sensing images
    Rubeena Vohra
    K. C. Tiwari
    Earth Science Informatics, 2023, 16 : 983 - 1003
  • [44] GA-SVM Algorithm for Improving Land-Cover Classification Using SAR and Optical Remote Sensing Data
    Sukawattanavijit, Chanika
    Chen, Jie
    Zhang, Hongsheng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (03) : 284 - 288
  • [45] Land cover classification using multi-fusion based dense transpose convolution in fully convolutional network with feature alignment for remote sensing images
    Vohra, Rubeena
    Tiwari, K. C.
    EARTH SCIENCE INFORMATICS, 2023, 16 (01) : 983 - 1003
  • [46] Land-Use and Land-Cover Classification Using a Human Group-Based Particle Swarm Optimization Algorithm with an LSTM Classifier on Hybrid Pre-Processing Remote-Sensing Images
    Rajendran, Ganesh B.
    Kumarasamy, Uma M.
    Zarro, Chiara
    Divakarachari, Parameshachari B.
    Ullo, Silvia L.
    REMOTE SENSING, 2020, 12 (24) : 1 - 28
  • [47] Land-cover classification with hyperspectral remote sensing image using CNN and spectral band selection
    Solomon, A. Arun
    Agnes, S. Akila
    REMOTE SENSING APPLICATIONS-SOCIETY AND ENVIRONMENT, 2023, 31
  • [48] DMAU-Net: An Attention-Based Multiscale Max-Pooling Dense Network for the Semantic Segmentation in VHR Remote-Sensing Images
    Yang, Yang
    Dong, Junwu
    Wang, Yanhui
    Yu, Bibo
    Yang, Zhigang
    REMOTE SENSING, 2023, 15 (05)
  • [49] A Novel Bottleneck Residual and Self-Attention Fusion-Assisted Architecture for Land Use Recognition in Remote Sensing Images
    Hamza, Ameer
    Khan, Muhammad Attique
    Ur Rehman, Shams
    Al-Khalidi, Mohammed
    Alzahrani, Ahmed Ibrahim
    Alalwan, Nasser
    Masood, Anum
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 2995 - 3009
  • [50] Small Object Detection in Remote Sensing Images Based on Window Self-Attention Mechanism
    Xu, Jiaxin
    Zhang, Qiao
    Liu, Yu
    Zheng, Mengting
    PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2023, 89 (08) : 489 - 497