Multilevel Feature Aggregated Network with Instance Contrastive Learning Constraint for Building Extraction

被引:6
作者
Li, Shiming [1 ,2 ,3 ]
Bao, Tingrui [1 ]
Liu, Hui [1 ,2 ,3 ]
Deng, Rongxin [1 ]
Zhang, Hui [1 ]
机构
[1] North China Univ Water Resources & Elect Power, Coll Surveying & Geo Informat, Zhengzhou 450046, Peoples R China
[2] Collaborat Innovat Ctr Geo Informat Technol Smart, Zhengzhou 450045, Peoples R China
[3] Minist Nat Resources, Key Lab Spatiotemporal Percept & Intelligent Proc, Zhengzhou 450045, Peoples R China
基金
中国国家自然科学基金; 芬兰科学院;
关键词
contrastive learning; feature aggregation; building extraction; remote sensing image; semantic segmentation; SEGMENTATION; FRAMEWORK; IMAGES;
D O I
10.3390/rs15102585
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Building footprint extraction from remotely sensed imagery is a critical task in the field of illegal building discovery, urban dynamic monitoring, and disaster emergency response. Recent research has made significant progress in this area by utilizing deep learning techniques. However, it remains difficult to efficiently balance the spatial detail and rich semantic features. In particular, the extracted building edge is often inaccurate, especially in areas where the buildings are densely distributed, and the boundary of adjacent building instances is difficult to distinguish accurately. Additionally, identifying buildings with varying scales remains a challenging problem. To address the above problems, we designed a novel framework that aggregated multilevel contextual information extracted from multiple encoders. Furthermore, we introduced an instance constraint into contrastive learning to enhance the robustness of the feature representation. Experimental results demonstrated that our proposed method achieved 91.07% and 74.58% on the intersection over union metric on the WHU and Massachusetts datasets, respectively, outperforming the most recent related methods. Notably, our method significantly improved the accuracy of building boundaries, especially at the building instance level, and the integrity of multi-scale buildings.
引用
收藏
页数:17
相关论文
共 52 条
[1]   Analysis on change detection techniques for remote sensing applications: A review [J].
Afaq, Yasir ;
Manocha, Ankush .
ECOLOGICAL INFORMATICS, 2021, 63
[2]   Automatic extraction of building roofs using LIDAR data and multispectral imagery [J].
Awrangjeb, Mohammad ;
Zhang, Chunsun ;
Fraser, Clive S. .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2013, 83 :1-18
[3]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[4]   BUILDING EXTRACTION FROM REMOTE SENSING DATA USING FULLY CONVOLUTIONAL NETWORKS [J].
Bittner, K. ;
Cui, S. ;
Reinartz, P. .
ISPRS HANNOVER WORKSHOP: HRIGI 17 - CMRT 17 - ISA 17 - EUROCOW 17, 2017, 42-1 (W1) :481-486
[5]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[6]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[7]   An end-to-end shape modeling framework for vectorized building outline generation from aerial images [J].
Chen, Qi ;
Wang, Lei ;
Waslander, Steven L. ;
Liu, Xiuguo .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 170 (114-126) :114-126
[8]   Automatic Rooftop Extraction in Nadir Aerial Imagery of Suburban Regions Using Corners and Variational Level Set Evolution [J].
Cote, Melissa ;
Saeedi, Parvaneh .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2013, 51 (01) :313-328
[9]   ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data [J].
Diakogiannis, Foivos, I ;
Waldner, Francois ;
Caccetta, Peter ;
Wu, Chen .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 162 :94-114
[10]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149