An improved U-Net method for the semantic segmentation of remote sensing images

被引:50
作者
Su, Zhongbin [1 ]
Li, Wei [1 ]
Ma, Zheng [1 ]
Gao, Rui [1 ]
机构
[1] Northeast Agr Univ, Coll Elect & Informat, Harbin 150030, Peoples R China
关键词
Deep learning; Artificial neural network; Remote sensing; U-Net; Semantic segmentation; ARCHITECTURE;
D O I
10.1007/s10489-021-02542-9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Foremost deep neural network models trained in natural scenes cannot transfer and apply to remote sensing image semantic segmentation well. Studies have shown that fine-tuning methods containing model fusion can alleviate this dilemma. In this paper, we provide an approach used to improve U-Net and propose an end-to-end deep convolutional neural network (DCNN) combining the superiorities of DenseNet, U-Net, dilated convolution, and DeconvNet. We evaluated the proposed method and model on the Potsdam orthophoto data set. Compared with U-Net, our approach increases the PA, mPA, and mIoU evaluation indexes by 11.1%, 14.0%, and 13.5%, respectively; the segmentation speed increases by approximately 1.18 times and the number of parameters is 59.0% that of U-Net. The experiments demonstrate that for the semantic segmentation of high-resolution remote sensing images, using the combined dilated convolutions as the primary feature extractor, using the transposed convolution to restore the size of the feature maps, and reducing the number of layers is an effective method to improve the comprehensive performance of U-Net. This research enriches the models based on DCNNs and the modes of using DCNNs in a specific scene.
引用
收藏
页码:3276 / 3288
页数:13
相关论文
共 40 条
[1]  
Alom MZ, 2018, PROC NAECON IEEE NAT, P228, DOI 10.1109/NAECON.2018.8556686
[2]  
[Anonymous], 2017, arXiv 2017 1704.06857
[3]   Segment-before-Detect: Vehicle Detection and Classification through Semantic Segmentation of Aerial Images [J].
Audebert, Nicolas ;
Le Saux, Bertrand ;
Lefevre, Sebastien .
REMOTE SENSING, 2017, 9 (04)
[4]   MFANet: A Multi-Level Feature Aggregation Network for Semantic Segmentation of Land Cover [J].
Chen, Bingyu ;
Xia, Min ;
Huang, Junqing .
REMOTE SENSING, 2021, 13 (04) :1-20
[5]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[6]   ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data [J].
Diakogiannis, Foivos, I ;
Waldner, Francois ;
Caccetta, Peter ;
Wu, Chen .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 162 :94-114
[7]   Semantic Segmentation With Context Encoding and Multi-Path Decoding [J].
Ding, Henghui ;
Jiang, Xudong ;
Shuai, Bing ;
Liu, Ai Qun ;
Wang, Gang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :3520-3533
[8]   The Importance of Skip Connections in Biomedical Image Segmentation [J].
Drozdzal, Michal ;
Vorontsov, Eugene ;
Chartrand, Gabriel ;
Kadoury, Samuel ;
Pal, Chris .
DEEP LEARNING AND DATA LABELING FOR MEDICAL APPLICATIONS, 2016, 10008 :179-187
[9]  
GLOROT X., 2011, INT C ARTIFICIAL INT, P315
[10]   Building Extraction Based on U-Net with an Attention Block and Multiple Losses [J].
Guo, Mingqiang ;
Liu, Heng ;
Xu, Yongyang ;
Huang, Ying .
REMOTE SENSING, 2020, 12 (09)