An End-To-End Bayesian Segmentation Network Based on a Generative Adversarial Network for Remote Sensing Images

被引:20
作者
Xiong, Dehui [1 ]
He, Chu [1 ,2 ]
Liu, Xinlong [1 ]
Liao, Mingsheng [2 ]
机构
[1] Wuhan Univ, Elect & Informat Sch, Wuhan 430072, Peoples R China
[2] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430079, Peoples R China
基金
中国国家自然科学基金;
关键词
image semantic segmentation; Bayesian; generative adversarial networks (GAN); fully convolutional networks (FCN); synthetic aperture radar (SAR);
D O I
10.3390/rs12020216
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Due to the development of deep convolutional neural networks (CNNs), great progress has been made in semantic segmentation recently. In this paper, we present an end-to-end Bayesian segmentation network based on generative adversarial networks (GANs) for remote sensing images. First, fully convolutional networks (FCNs) and GANs are utilized to realize the derivation of the prior probability and the likelihood to the posterior probability in Bayesian theory. Second, the cross-entropy loss in the FCN serves as an a priori to guide the training of the GAN, so as to avoid the problem of mode collapse during the training process. Third, the generator of the GAN is used as a teachable spatial filter to construct the spatial relationship between each label. Some experiments were performed on two remote sensing datasets, and the results demonstrate that the training of the proposed method is more stable than other GAN based models. The average accuracy and mean intersection (MIoU) of the two datasets were 0.0465 and 0.0821, and 0.0772 and 0.1708 higher than FCN, respectively.
引用
收藏
页数:21
相关论文
共 50 条
[31]   Single Pixel Imaging Based on Generative Adversarial Network Optimized With Multiple Prior Information [J].
Sun, Shida ;
Yan, Qiurong ;
Zheng, Yongjian ;
Zhen Wei ;
Lin, Jian ;
Cai, Yilin .
IEEE PHOTONICS JOURNAL, 2022, 14 (04)
[32]   MULTI-SOURCE FUSION NETWORK FOR REMOTE SENSING IMAGE SEGMENTATION WITH HIERARCHICAL TRANSFORMER [J].
Liu, Bo ;
Ren, Bo ;
Hou, Biao ;
Gu, Yu .
IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, :6318-6321
[33]   A Directional Generation Algorithm for SAR Image Based on Azimuth-Guided Statistical Generative Adversarial Network [J].
Peng, Guobei ;
Liu, Ming ;
Chen, Shichao ;
Tao, Mingliang ;
Li, Yiyang ;
Xing, Mengdao .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2024, 72 :5406-5421
[34]   TMG-GAN: Generative Adversarial Networks-Based Imbalanced Learning for Network Intrusion Detection [J].
Ding, Hongwei ;
Sun, Yu ;
Huang, Nana ;
Shen, Zhidong ;
Cui, Xiaohui .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 :1156-1167
[35]   Visual image reconstruction based on EEG signals using a generative adversarial and deep fuzzy neural network [J].
Ahmadieh, Hajar ;
Gassemi, Farnaz ;
Moradi, Mohammad Hasan .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 87
[36]   ADAPTIVE MULTI-ORGAN LOSS BASED GENERATIVE ADVERSARIAL NETWORK FOR AUTOMATIC DOSE PREDICTION IN RADIOTHERAPY [J].
Cao, Chongyang ;
Xiao, Jianghong ;
Zhan, Bo ;
Peng, Xingchen ;
Wu, Xi ;
Zhou, Jiliu ;
Wang, Yan .
2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, :212-215
[37]   Thyroid Nodule Segmentation in Ultrasound Images Based on Cascaded Convolutional Neural Network [J].
Ying, Xiang ;
Yu, Zhihui ;
Yu, Ruiguo ;
Li, Xuewei ;
Yu, Mei ;
Zhao, Mankun ;
Liu, Kai .
NEURAL INFORMATION PROCESSING (ICONIP 2018), PT VI, 2018, 11306 :373-384
[38]   Fluid grey 2: How well does generative adversarial network learn deeper topology structure in architecture that matches images? [J].
Qiu, Yayan ;
Hanna, Sean .
JOURNAL OF BUILDING ENGINEERING, 2024, 98
[39]   A Novel Intelligent Fault Diagnosis Method for Rolling Bearings Based on Wasserstein Generative Adversarial Network and Convolutional Neural Network under Unbalanced Dataset [J].
Tang, Hongtao ;
Gao, Shengbo ;
Wang, Lei ;
Li, Xixing ;
Li, Bing ;
Pang, Shibao .
SENSORS, 2021, 21 (20)
[40]   Probabilistic neural network based on multinomial model for remote sensing image classification [J].
Setiawan, W ;
Murni, A ;
Kusumoputro, B .
CCCT 2003, VOL 5, PROCEEDINGS: COMPUTER, COMMUNICATION AND CONTROL TECHNOLOGIES: II, 2003, :132-136