Extraction of urban multi-class from high-resolution images using pyramid generative adversarial networks

被引:8
作者
Alshehhi, Rasha [1 ]
Marpu, Prashanth R. [2 ]
机构
[1] New York Univ, Ctr Space Sci, Abu Dhabi, U Arab Emirates
[2] Khalifa Univ Sci & Technol, Dept Elect & Comp Engn, Abu Dhabi, U Arab Emirates
关键词
Multi-class; Generative adversarial networks; Dice coefficient; High-resolution images; SEGMENTATION; BUILDINGS;
D O I
10.1016/j.jag.2021.102379
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
The extraction of man-made structures from high-resolution images plays a vital role in various urban applications. This task is regularly complicated due to the heterogeneous appearance of the objects in the satellite images. In this work, we propose a multi-scale Generative Adversarial network to classify high-resolution images into urban classes (surface, building, tree, low-vegetation, car). We use uNet with EfficientNet B3 architecture as a generator and we use ResNet 18 architecture as a discriminator. We use a conditional generative loss based on the Dice coefficient and softmax functions. Experiments on the Vaihingen and Potsdam datasets were conducted to demonstrate the performance and we compare the results with other architectures. The results demonstrate the validity and higher performance of the proposed multi-scale network for extracting classes in urban areas with average F1-score 89.0% and 88.8%, and average accuracy 89.9% and 91.8% for Vaihingen and Potsdam datasets, respectively.
引用
收藏
页数:14
相关论文
共 31 条
[11]   Densely Connected Convolutional Networks [J].
Huang, Gao ;
Liu, Zhuang ;
van der Maaten, Laurens ;
Weinberger, Kilian Q. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2261-2269
[12]   Image-to-Image Translation with Conditional Adversarial Networks [J].
Isola, Phillip ;
Zhu, Jun-Yan ;
Zhou, Tinghui ;
Efros, Alexei A. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5967-5976
[13]   Semantic Segmentation of Small Objects and Modeling of Uncertainty in Urban Remote Sensing Images Using Deep Convolutional Neural Networks [J].
Kampffmeyer, Michael ;
Salberg, Arnt-Borre ;
Jenssen, Robert .
PROCEEDINGS OF 29TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, (CVPRW 2016), 2016, :680-688
[14]  
Kingma DP, 2015, C TRACK P
[15]  
Lagrange A, 2015, INT GEOSCI REMOTE SE, P4173, DOI 10.1109/IGARSS.2015.7326745
[16]   Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network [J].
Ledig, Christian ;
Theis, Lucas ;
Huszar, Ferenc ;
Caballero, Jose ;
Cunningham, Andrew ;
Acosta, Alejandro ;
Aitken, Andrew ;
Tejani, Alykhan ;
Totz, Johannes ;
Wang, Zehan ;
Shi, Wenzhe .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :105-114
[17]  
Li H., 2020, IEEE Geoscience and Remote Sensing Letters, P1
[18]  
Li W., 2019, DEEP LEARNING BASED
[19]   Dense Semantic Labeling of Very-High-Resolution Aerial Imagery and LiDAR with Fully-Convolutional Neural Networks and Higher-Order CRFs [J].
Liu, Yansong ;
Piramanayagam, Sankaranarayanan ;
Monteiro, Sildomar T. ;
Saber, Eli .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1561-1570
[20]   Classification with an edge: Improving semantic with boundary detection [J].
Marmanis, D. ;
Schindler, K. ;
Wegner, J. D. ;
Galliani, S. ;
Datcu, M. ;
Stilla, U. .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 135 :158-172