Transferable Contextual Network for Rural Road Extraction from UAV-Based Remote Sensing Images

被引:0
作者
Wang, Jian [1 ,2 ]
Wang, Renlong [1 ]
Liu, Yahui [1 ]
Zhang, Fei [1 ]
Cheng, Ting [1 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming 650504, Peoples R China
[2] Kunming Univ Sci & Technol, Yunnan Key Lab Artificial Intelligence, Kunming 650504, Peoples R China
关键词
remote sensing; rural road extraction; semantic segmentation; Stable Diffusion; SEMANTIC SEGMENTATION;
D O I
10.3390/s25051394
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Road extraction from UAV-based remote sensing images in rural areas presents significant challenges due to the diverse and complex characteristics of rural roads. Additionally, acquiring UAV remote sensing data for rural areas is challenging due to the high cost of equipment, the lack of clear road boundaries requiring extensive manual annotation, and limited regional policy support for UAV operations. To address these challenges, we propose a transferable contextual network (TCNet), designed to enhance the transferability and accuracy of rural road extraction. We employ a Stable Diffusion model for data augmentation, generating diverse training samples and providing a new method for acquiring remote sensing images. TCNet integrates the clustered contextual Transformer (CCT) module, clustered cross-attention (CCA) module, and CBAM attention mechanism to ensure efficient model transferability across different geographical and climatic conditions. Moreover, we design a new loss function, the Dice-BCE-Lovasz loss (DBL loss), to accelerate convergence and improve segmentation performance in handling imbalanced data. Experimental results demonstrate that TCNet, with only 23.67 M parameters, performs excellently on the DeepGlobe and road datasets and shows outstanding transferability in zero-shot testing on rural remote sensing data. TCNet performs well on segmentation tasks without any fine-tuning for regions such as Burgundy, France, and Yunnan, China.
引用
收藏
页数:22
相关论文
共 48 条
  • [1] VNet: An End-to-End Fully Convolutional Neural Network for Road Extraction From High-Resolution Remote Sensing Data
    Abdollahi, Abolfazl
    Pradhan, Biswajeet
    Alamri, Abdullah
    [J]. IEEE ACCESS, 2020, 8 : 179424 - 179436
  • [2] Chaurasia A, 2017, 2017 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP)
  • [3] Dual Crisscross Attention Module for Road Extraction from Remote Sensing Images
    Chen, Chuan
    Zhao, Huilin
    Cui, Wei
    He, Xin
    [J]. SENSORS, 2021, 21 (20)
  • [4] SDFCNv2: An Improved FCN Framework for Remote Sensing Images Semantic Segmentation
    Chen, Guanzhou
    Tan, Xiaoliang
    Guo, Beibei
    Zhu, Kun
    Liao, Puyun
    Wang, Tong
    Wang, Qing
    Zhang, Xiaodong
    [J]. REMOTE SENSING, 2021, 13 (23)
  • [5] Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
    Chen, Liang-Chieh
    Zhu, Yukun
    Papandreou, George
    Schroff, Florian
    Adam, Hartwig
    [J]. COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 : 833 - 851
  • [6] Reconstruction Bias U-Net for Road Extraction From Optical Remote Sensing Images
    Chen, Ziyi
    Wang, Cheng
    Li, Jonathan
    Xie, Nianci
    Han, Yan
    Du, Jixiang
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 2284 - 2294
  • [7] Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities
    Cheng, Gong
    Xie, Xingxing
    Han, Junwei
    Guo, Lei
    Xia, Gui-Song
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 : 3735 - 3756
  • [8] Creating Roadmaps in Aerial Images with Generative Adversarial Networks and Smoothing-based Optimization
    Costea, Dragos
    Marcu, Alina
    Slusanschi, Emil
    Leordeanu, Marius
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, : 2100 - 2109
  • [9] Boundary-Aware Feature Propagation for Scene Segmentation
    Ding, Henghui
    Jiang, Xudong
    Liu, Ai Qun
    Thalmann, Nadia Magnenat
    Wang, Gang
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 6818 - 6828
  • [10] Convolutional Neural Network With Data Augmentation for SAR Target Recognition
    Ding, Jun
    Chen, Bo
    Liu, Hongwei
    Huang, Mengyuan
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2016, 13 (03) : 364 - 368