SER-UNet algorithm for building extraction from high-resolution remote sensing image combined with multipath

被引:0
作者
Hu M. [1 ]
Li J. [1 ]
Yao Y. [1 ]
Xiaohui A. [1 ]
Lu M. [1 ]
Li W. [1 ]
机构
[1] Faculty of Land and Resources Engineering, Kunming University of Science and Technology, Kunming
来源
Cehui Xuebao/Acta Geodaetica et Cartographica Sinica | 2023年 / 52卷 / 05期
基金
中国国家自然科学基金;
关键词
attention mechanism; building extraction; high-resolution remote sensing image; parallel multipath; skip connection;
D O I
10.11947/j.AGCS.2023.20210691
中图分类号
学科分类号
摘要
Aiming at the problems of inaccurate edges and loss of small buildings in the extracted buildings due to the inability of deep convolution to take into account global features and local features, the SER-UNet algorithm is proposed based on attention mechanism and skip connection. SER-UNet algorithm couples SE_ResNet and max pooling layers in the encoder stage, and the SEResNet structure and deconvolution are used in the decoder stage. The feature map is output after fusing the shallow features extracted by the encoder and the deep features extracted by the decoder through skip connections. In order to analyze the effectiveness of the method, the SER-UNet is used to replace the feature extraction structure in the original network in the parallel multi-path feature extraction stage of the MAP-Net network. Finally, the method proposed is experimentally evaluated on the WHU dataset and the Inria dataset, and the loU and precision reach 91.46%, 82.61% and 95.67%, 92.75%, compared with UNet, PSPNet, ResNetlOl, and MAP-Net Networks, the loU is increased by 0.49%, 0.14%, 1.89%, and 1.57%, and the precision is increased by 0.14%, 1.06%, 2.42% and 1.09%, respectively. To further analyze the validity of the SER-UNet algorithm, the edge integrity and small extraction verification loU and precision reached 85.32% and 94.13% on the Aeriallmage dataset. The experiment results show that the MAP-Net parallel multipath network combined with SER-UNet algorithm shows good generalization ability. In addition, the SER-UNet algorithm can be effectively embedded in PSPNet, ResNetlOl, HRNetv2 and other Networks to improve the ability of Network feature representation. © 2023 SinoMaps Press. All rights reserved.
引用
收藏
页码:808 / 817
页数:9
相关论文
共 28 条
[1]  
MAYER H., Automatic object extraction from aerial imagery a survey focusing on buildings, Computer Vision and Image Understanding, 74, 2, pp. 138-149, (1999)
[2]  
LIN C, NEVATIA R., Building detection and description from a single intensity image[J], Computer vision and image understanding, 72, 2, pp. 101-121, (1998)
[3]  
DONG Yanni, DU Bo, ZHANG Liangpei, Target detection based on random forest metric learning[J], IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 8, 4, pp. 1830-1838, (2015)
[4]  
WEI Yanfeng, ZHAO Zhongming, SONG Jianghong, Urban building extraction from high-resolution satellite panchromatic image using clustering and edge detection, Proceedings of 2004 IEEE International Geoscience and Remote Sensing Symposium, pp. 2008-2010, (2004)
[5]  
DU Jianli, CHEN Dong, WANG Ruisheng, Et al., A novel framework for 2.5-D building contouring from large-scale residential scenes [J], IEEE Transactions on Geoscience and Remote Sensing, 57, 6, pp. 4121-4145, (2019)
[6]  
SHACKELFORD A K, DAVIS C H., WANG Xiangyun, Automated 2D building footprint extraction from high-resolution satellite multispectral imagery, Proceedings of 2004 IEEE International Geoscience and Remote Sensing Symposium, pp. 1996-1999, (2004)
[7]  
Mohammad, Awrangjeb, Automatic extraction of building roofs using LiDAR data and multispectral imagery, ISPRS Journal of Photogrammetry and Remote Sensing, 83, pp. 1-18, (2013)
[8]  
CUI Weihong, ZHANG Yi, An effective graph-based hierarchy image segmentation [J], Intelligent Automation & Soft Computing, 17, 7, pp. 969-981, (2011)
[9]  
FAN Rongshuang, CHEN Yang, XU Qlheng, Et al., A high-resolution remote sensing image building extraction method based on deep learning [J], Acta Geodaetica et Cartographica Sinica, 48, 1, pp. 34-41, (2019)
[10]  
GONG Jianya, Shunping Jl, Photogrammetry and deep learning [J], Journal of Geodesy and Geoinformation Science, 1, pp. 1-15, (2018)