Sgformer: A Local and Global Features Coupling Network for Semantic Segmentation of Land Cover

被引:22
作者
Weng, Liguo [1 ]
Pang, Kai [1 ]
Xia, Min [1 ]
Lin, Haifeng [2 ]
Qian, Ming [3 ]
Zhu, Changjie [4 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Collaborat Innovat Ctr Atmospher Environm & Equipm, B DAT, Nanjing 210044, Peoples R China
[2] Nanjing Forestry Univ, Coll Informat Sci & Technol, Nanjing 210037, Peoples R China
[3] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & Re, Wuhan 430072, Peoples R China
[4] Hohai Univ, Changzhou Campus, Nanjing 210000, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; land cover; neural network; remote sensing; semantic segmentation; CLASSIFIER;
D O I
10.1109/JSTARS.2023.3295729
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the introduction of Earth observation satellites, the classification technology through high-definition remote sensing images appeared. After decades of evolution, the land cover classification method in high-definition satellite maps has been gradually improved. Recently, high-definition remote sensing maps have been applied to land cover classification. Nowadays, classification methods using high-definition maps have these following problems. First, the traditional land cover classification methods cannot process the rich details in high-definition maps. Second, there are different acquisition conditions in the maps of different regions, which leads to distortion, deformation, and illumination blur of remote sensing images. Third, the existing methods are unable to provide a good generalization performance. To address these issues, a dual-branch parallel network structure is proposed, called Sgformer, to improve the performance of the transformer in the context of high-definition remote sensing maps. The network enhances perceptual learning with convolution operators that extract local features and a self-attention module that captures global representations. Local information and global representations with semantic divergence are fused through a feature coupling module. At last, a decoder is designed to maximize the preservation of local features and global representations and to better recover high-definition feature maps. The results of semantic segmentation experiments show that the methodology in this study has higher accuracy than the other methodologies.
引用
收藏
页码:6812 / 6824
页数:13
相关论文
共 62 条
  • [1] Segment-before-Detect: Vehicle Detection and Classification through Semantic Segmentation of Aerial Images
    Audebert, Nicolas
    Le Saux, Bertrand
    Lefevre, Sebastien
    [J]. REMOTE SENSING, 2017, 9 (04)
  • [2] SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation
    Badrinarayanan, Vijay
    Kendall, Alex
    Cipolla, Roberto
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) : 2481 - 2495
  • [3] Semantic scene segmentation in unstructured environment with modified DeepLabV3+
    Baheti, Bhakti
    Innani, Shubham
    Gajre, Suhas
    Talbar, Sanjay
    [J]. PATTERN RECOGNITION LETTERS, 2020, 138 : 223 - 229
  • [4] LandCover.ai: Dataset for Automatic Mapping of Buildings, Woodlands, Water and Roads from Aerial Imagery
    Boguszewski, Adrian
    Batorski, Dominik
    Ziemba-Jankowska, Natalia
    Dziedzic, Tomasz
    Zambrzycka, Anna
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 1102 - 1110
  • [5] Online Exemplar-Based Fully Convolutional Network for Aircraft Detection in Remote Sensing Images
    Cai, Bowen
    Jiang, Zhiguo
    Zhang, Haopeng
    Yao, Yuan
    Nie, Shanlan
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2018, 15 (07) : 1095 - 1099
  • [6] Cao H., 2021, arXiv, DOI DOI 10.48550/ARXIV.2105.05537
  • [7] Chanan G., 2017, NIPS W
  • [8] MANet: a multi-level aggregation network for semantic segmentation of high-resolution remote sensing images
    Chen, Bingyu
    Xia, Min
    Qian, Ming
    Huang, Junqing
    [J]. INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (15-16) : 5874 - 5894
  • [9] Chen J., 2021, arXiv, DOI DOI 10.48550/ARXIV.2102.04306
  • [10] Double Branch Parallel Network for Segmentation of Buildings and Waters in Remote Sensing Images
    Chen, Jing
    Xia, Min
    Wang, Dehao
    Lin, Haifeng
    [J]. REMOTE SENSING, 2023, 15 (06)