An End-To-End Bayesian Segmentation Network Based on a Generative Adversarial Network for Remote Sensing Images

被引:20
作者
Xiong, Dehui [1 ]
He, Chu [1 ,2 ]
Liu, Xinlong [1 ]
Liao, Mingsheng [2 ]
机构
[1] Wuhan Univ, Elect & Informat Sch, Wuhan 430072, Peoples R China
[2] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430079, Peoples R China
基金
中国国家自然科学基金;
关键词
image semantic segmentation; Bayesian; generative adversarial networks (GAN); fully convolutional networks (FCN); synthetic aperture radar (SAR);
D O I
10.3390/rs12020216
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Due to the development of deep convolutional neural networks (CNNs), great progress has been made in semantic segmentation recently. In this paper, we present an end-to-end Bayesian segmentation network based on generative adversarial networks (GANs) for remote sensing images. First, fully convolutional networks (FCNs) and GANs are utilized to realize the derivation of the prior probability and the likelihood to the posterior probability in Bayesian theory. Second, the cross-entropy loss in the FCN serves as an a priori to guide the training of the GAN, so as to avoid the problem of mode collapse during the training process. Third, the generator of the GAN is used as a teachable spatial filter to construct the spatial relationship between each label. Some experiments were performed on two remote sensing datasets, and the results demonstrate that the training of the proposed method is more stable than other GAN based models. The average accuracy and mean intersection (MIoU) of the two datasets were 0.0465 and 0.0821, and 0.0772 and 0.1708 higher than FCN, respectively.
引用
收藏
页数:21
相关论文
共 40 条
[31]   Learning Deconvolution Network for Semantic Segmentation [J].
Noh, Hyeonwoo ;
Hong, Seunghoon ;
Han, Bohyung .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1520-1528
[32]   Large Kernel Matters - Improve Semantic Segmentation by Global Convolutional Network [J].
Peng, Chao ;
Zhang, Xiangyu ;
Yu, Gang ;
Luo, Guiming ;
Sun, Jian .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1743-1751
[33]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241
[34]   Semi Supervised Semantic Segmentation Using Generative Adversarial Network [J].
Souly, Nasim ;
Spampinato, Concetto ;
Shah, Mubarak .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :5689-5697
[35]   Land-cover classification with high-resolution remote sensing images using transferable deep models [J].
Tong, Xin-Yi ;
Xia, Gui-Song ;
Lu, Qikai ;
Shen, Huanfeng ;
Li, Shengyang ;
You, Shucheng ;
Zhang, Liangpei .
REMOTE SENSING OF ENVIRONMENT, 2020, 237
[36]  
Vezhnevets A, 2012, PROC CVPR IEEE, P845, DOI 10.1109/CVPR.2012.6247757
[37]  
Wei X, 2017, INT GEOSCI REMOTE SE, P1776, DOI 10.1109/IGARSS.2017.8127319
[38]   THE POTTS-MODEL [J].
WU, FY .
REVIEWS OF MODERN PHYSICS, 1982, 54 (01) :235-268
[39]   A Bayesian Network Model for Automatic and Interactive Image Segmentation [J].
Zhang, Lei ;
Ji, Qiang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (09) :2582-2593
[40]   Hybrid region merging method for segmentation of high-resolution remote sensing images [J].
Zhang, Xueliang ;
Xiao, Pengfeng ;
Feng, Xuezhi ;
Wang, Jiangeng ;
Wang, Zuo .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2014, 98 :19-28