SWINT-RESNet: An Improved Remote Sensing Image Segmentation Model Based on Transformer

被引:2
|
作者
Ma, Yuefeng [1 ]
Wang, Yingli [1 ]
Liu, Xingya [1 ]
Wang, Haiying [2 ,3 ]
机构
[1] Henan Univ, Coll Geog & Environm Sci, Zhengzhou 475000, Peoples R China
[2] Minist Educ, Key Lab Geospatial Technol Middle & Lower Yellow R, Kaifeng 475004, Peoples R China
[3] Henan Univ, Henan Technol Innovat Ctr Spatio Temporal Big Data, Zhengzhou 450046, Peoples R China
关键词
Feature extraction; Transformers; Remote sensing; Accuracy; Semantics; Convolutional neural networks; Semantic segmentation; Deep learning; remote sensing image segmentation; RESNet; semantic segmentation; transformer;
D O I
10.1109/LGRS.2024.3433034
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Deep neural networks have been widely used in remote sensing image segmentation. Nowadays, artificial intelligence methods are increasingly applied to remote sensing feature classification. Although convolutional neural networks (CNNs) are widely used for image segmentation tasks, their global feature extraction with increasing image samples is insufficient. Furthermore, transformer is now being focused on computer vision. However, although transformer can capture the global information of remote sensing images, it cannot adequately model the detailed information of image changes. To comprehensively compensate for the defects of CNNs and the transformer network in feature extraction, this study proposes a semantic segmentation network with multifeature fusion (SWINT-RESNet). This network combines the transformer-extracted global and local features and those of CNNs to improve the accuracy of remote sensing image segmentation. The experiments show that the segmentation performance of SWINT-RESNet is superior for both small and medium sample remote sensing image datasets.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Enhancing Multiscale Representations With Transformer for Remote Sensing Image Semantic Segmentation
    Xiao, Tao
    Liu, Yikun
    Huang, Yuwen
    Li, Mingsong
    Yang, Gongping
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [2] RSSGLT: Remote Sensing Image Segmentation Network Based on Global-Local Transformer
    Kumar, Satyawant
    Kumar, Abhishek
    Lee, Dong-Gyu
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [3] Swin Transformer Embedding UNet for Remote Sensing Image Semantic Segmentation
    He, Xin
    Zhou, Yong
    Zhao, Jiaqi
    Zhang, Di
    Yao, Rui
    Xue, Yong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] Hybrid Attention Fusion Embedded in Transformer for Remote Sensing Image Semantic Segmentation
    Chen, Yan
    Dong, Quan
    Wang, Xiaofeng
    Zhang, Qianchuan
    Kang, Menglei
    Jiang, Wenxiang
    Wang, Mengyuan
    Xu, Lixiang
    Zhang, Chen
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 4421 - 4435
  • [5] DSViT: Dynamically Scalable Vision Transformer for Remote Sensing Image Segmentation and Classification
    Wang, Falin
    Ji, Jian
    Wang, Yuan
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 5441 - 5452
  • [6] Enhancing Remote Sensing Semantic Segmentation Accuracy and Efficiency Through Transformer and Knowledge Distillation
    Zheng, Kang
    Chen, Yu
    Wang, Jingrong
    Liu, Zhifei
    Bao, Shuai
    Zhan, Jiao
    Shen, Nan
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2025, 18 : 4074 - 4092
  • [7] Combining Swin Transformer With UNet for Remote Sensing Image Semantic Segmentation
    Fan, Lili
    Zhou, Yu
    Liu, Hongmei
    Li, Yunjie
    Cao, Dongpu
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61 : 1 - 11
  • [8] Efficient Transformer for Remote Sensing Image Segmentation
    Xu, Zhiyong
    Zhang, Weicun
    Zhang, Tianxiang
    Yang, Zhifang
    Li, Jiangyun
    REMOTE SENSING, 2021, 13 (18)
  • [9] STransFuse: Fusing Swin Transformer and Convolutional Neural Network for Remote Sensing Image Semantic Segmentation
    Gao, Liang
    Liu, Hui
    Yang, Minhang
    Chen, Long
    Wan, Yaling
    Xiao, Zhengqing
    Qian, Yurong
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 (14) : 10990 - 11003
  • [10] Co-Training Transformer for Remote Sensing Image Classification, Segmentation, and Detection
    Li, Qingyun
    Chen, Yushi
    He, Xin
    Huang, Lingbo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 (1-18): : 1 - 18