Extraction of urban multi-class from high-resolution images using pyramid generative adversarial networks

被引:8
作者
Alshehhi, Rasha [1 ]
Marpu, Prashanth R. [2 ]
机构
[1] New York Univ, Ctr Space Sci, Abu Dhabi, U Arab Emirates
[2] Khalifa Univ Sci & Technol, Dept Elect & Comp Engn, Abu Dhabi, U Arab Emirates
关键词
Multi-class; Generative adversarial networks; Dice coefficient; High-resolution images; SEGMENTATION; BUILDINGS;
D O I
10.1016/j.jag.2021.102379
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
The extraction of man-made structures from high-resolution images plays a vital role in various urban applications. This task is regularly complicated due to the heterogeneous appearance of the objects in the satellite images. In this work, we propose a multi-scale Generative Adversarial network to classify high-resolution images into urban classes (surface, building, tree, low-vegetation, car). We use uNet with EfficientNet B3 architecture as a generator and we use ResNet 18 architecture as a discriminator. We use a conditional generative loss based on the Dice coefficient and softmax functions. Experiments on the Vaihingen and Potsdam datasets were conducted to demonstrate the performance and we compare the results with other architectures. The results demonstrate the validity and higher performance of the proposed multi-scale network for extracting classes in urban areas with average F1-score 89.0% and 88.8%, and average accuracy 89.9% and 91.8% for Vaihingen and Potsdam datasets, respectively.
引用
收藏
页数:14
相关论文
共 31 条
[1]   Simultaneous extraction of roads and buildings in remote sensing imagery with convolutional neural networks [J].
Alshehhi, Rasha ;
Marpu, Prashanth Reddy ;
Woon, Wei Lee ;
Dalla Mura, Mauro .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2017, 130 :139-149
[2]  
[Anonymous], 2001, ADAP COMP MACH LEARN
[3]  
[Anonymous], 2017, P IEEE C COMP VIS PA
[4]   Beyond RGB: Very high resolution urban remote sensing with multimodal deep networks [J].
Audebert, Nicolas ;
Le Saux, Bertrand ;
Lefevre, Sebastien .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 140 :20-32
[5]  
Bischke B, 2018, INT GEOSCI REMOTE SE, P6191, DOI 10.1109/IGARSS.2018.8517836
[6]   Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networks [J].
Bousmalis, Konstantinos ;
Silberman, Nathan ;
Dohan, David ;
Erhan, Dumitru ;
Krishnan, Dilip .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :95-104
[7]  
Denton Emily L., 2015, P NIPS, P1486
[8]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[9]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[10]   Generative Adversarial Networks-Based Semi-Supervised Learning for Hyperspectral Image Classification [J].
He, Zhi ;
Liu, Han ;
Wang, Yiwen ;
Hu, Jie .
REMOTE SENSING, 2017, 9 (10)