SWINT-RESNet: An Improved Remote Sensing Image Segmentation Model Based on Transformer

被引:2
作者
Ma, Yuefeng [1 ]
Wang, Yingli [1 ]
Liu, Xingya [1 ]
Wang, Haiying [2 ,3 ]
机构
[1] Henan Univ, Coll Geog & Environm Sci, Zhengzhou 475000, Peoples R China
[2] Minist Educ, Key Lab Geospatial Technol Middle & Lower Yellow R, Kaifeng 475004, Peoples R China
[3] Henan Univ, Henan Technol Innovat Ctr Spatio Temporal Big Data, Zhengzhou 450046, Peoples R China
关键词
Feature extraction; Transformers; Remote sensing; Accuracy; Semantics; Convolutional neural networks; Semantic segmentation; Deep learning; remote sensing image segmentation; RESNet; semantic segmentation; transformer;
D O I
10.1109/LGRS.2024.3433034
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Deep neural networks have been widely used in remote sensing image segmentation. Nowadays, artificial intelligence methods are increasingly applied to remote sensing feature classification. Although convolutional neural networks (CNNs) are widely used for image segmentation tasks, their global feature extraction with increasing image samples is insufficient. Furthermore, transformer is now being focused on computer vision. However, although transformer can capture the global information of remote sensing images, it cannot adequately model the detailed information of image changes. To comprehensively compensate for the defects of CNNs and the transformer network in feature extraction, this study proposes a semantic segmentation network with multifeature fusion (SWINT-RESNet). This network combines the transformer-extracted global and local features and those of CNNs to improve the accuracy of remote sensing image segmentation. The experiments show that the segmentation performance of SWINT-RESNet is superior for both small and medium sample remote sensing image datasets.
引用
收藏
页数:5
相关论文
共 50 条
  • [31] AAFormer: Attention-Attended Transformer for Semantic Segmentation of Remote Sensing Images
    Li, Xin
    Xu, Feng
    Li, Linyang
    Xu, Nan
    Liu, Fan
    Yuan, Chi
    Chen, Ziqi
    Lyu, Xin
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [32] Class-Guided Swin Transformer for Semantic Segmentation of Remote Sensing Imagery
    Meng, Xiaoliang
    Yang, Yuechi
    Wang, Libo
    Wang, Teng
    Li, Rui
    Zhang, Ce
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [33] CMLFormer: CNN and Multiscale Local-Context Transformer Network for Remote Sensing Images Semantic Segmentation
    Wu, Honglin
    Zhang, Min
    Huang, Peng
    Tang, Wenlong
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 7233 - 7241
  • [34] Interactive Concept Network Enhanced Transformer for Remote Sensing Image Captioning
    Zhang, Cheng
    Ren, Zhongle
    Hou, Biao
    Meng, Jianhua
    Li, Weibin
    Jiao, Licheng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [35] A Gather-to-Guide Network for Remote Sensing Semantic Segmentation of RGB and Auxiliary Image
    Zheng, Xianwei
    Wu, Xiujie
    Huan, Linxi
    He, Wei
    Zhang, Hongyan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [36] UAV Remote-Sensing Image Semantic Segmentation Strategy Based on Thermal Infrared and Multispectral Image Features
    Nuradili, Pakezhamu
    Zhou, Ji
    Zhou, Xiangbing
    Ma, Jin
    Wang, Ziwei
    Meng, Lingxuan
    Tang, Wenbin
    Meng, Yizhen
    IEEE JOURNAL ON MINIATURIZATION FOR AIR AND SPACE SYSTEMS, 2023, 4 (03): : 311 - 319
  • [37] Efficient Remote-Sensing Segmentation With Generative Adversarial Transformer
    Qiu, Luyi
    Yu, Dayu
    Zhang, Xiaofeng
    Zhang, Chenxiao
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [38] NT-Net: A Semantic Segmentation Network for Extracting Lake Water Bodies From Optical Remote Sensing Images Based on Transformer
    Zhong, Hai-Feng
    Sun, Qing
    Sun, Hong-Mei
    Jia, Rui-Sheng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [39] Multielement-Feature-Based Hierarchical Context Integration Network for Remote Sensing Image Segmentation
    Yang, Yunsong
    Yuan, Genji
    Li, Jinjiang
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2024, 17 : 7971 - 7985
  • [40] TCIANet: Transformer-Based Context Information Aggregation Network for Remote Sensing Image Change Detection
    Xu, Xintao
    Li, Jinjiang
    Chen, Zheng
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2023, 16 : 1951 - 1971