Probabilistic SAR-based water segmentation with adapted Bayesian convolutional neural network

被引:29
作者
Hertel, Victor [1 ]
Chow, Candace [1 ]
Wani, Omar [2 ,3 ]
Wieland, Marc [1 ]
Martinis, Sandro [1 ]
机构
[1] German Aerosp Ctr DLR, German Remote Sensing Data Ctr DFD, Munchener Str 20, D-82234 Wessling Oberpfaffenhofen, Germany
[2] NYU, Dept Civil & Urban Engn, Brooklyn, NY 11201 USA
[3] Univ Calif Berkeley, Environm Syst Dynam Lab, Berkeley, CA 94720 USA
基金
瑞士国家科学基金会;
关键词
Semantic segmentation; Bayesian convolutional neural network; MCDN; Uncertainty quantification; SAR; Sentinel-1; Crisis information management;
D O I
10.1016/j.rse.2022.113388
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Geospatial resources, including satellite-based synthetic aperture radar (SAR) and optical data, have been instrumental in providing time-sensitive information about the extent and impact of natural hazard events, such as floods, to support emergency response and hazard management efforts. In effect, finite resources can be better optimized to support the needs of often extensively affected areas. However, the derivation of SAR-based flood information is not without its challenges and inaccurate flood detection can result in poor decision-making and non-trivial, adverse consequences. Reliable uncertainty quantification of flood extent estimates addresses this risk. In this context, our study presents the results of two probabilistic convolutional neural networks (CNNs) adapted for SAR-based water segmentation with freely available Sentinel-1 interferometric wide (IW) swath ground range detected (GRD) data. In particular, the performance of a variational inference-based Bayesian convolutional neural network (BCNN) is evaluated against that of a Monte Carlo dropout network (MCDN). In previous studies where uncertainty information has been generated along with segmentation results, MCDN has been more commonly applied as an approximation of Bayesian deep learning. Differences between the two approaches are highlighted with the application of a set of extended performance metrics. Both segmentation and uncertainty outputs are evaluated at data-, model-, tile-and scene-levels. The methods are demonstrated on the binary segmentation of a reference water dataset. We show that while different probabilistic techniques return comparable segmentation accuracies, they are differentiated based on their performance in assigning reliable probabilities. In particular, MCDNs characterized by more restrictive architectures generally lead to over-confident prediction intervals, whereas BCNNs have greater flexibility to learn the mean and the spread of the parameter posterior. Furthermore, we demonstrate that examining the (inaccurate, certain) metric is a better indicator of reliable uncertainty quantification and the BCNN is recommended to quantify uncertainties asso-ciated with SAR-based segmentation outputs. This information is especially valuable where the cost of inaccurate detections (false-positive and false-negative) is high. These preliminary findings highlight how the manner in which probabilities are properly assigned and their inclusion are instrumental and complementary to the pro-duction of flood masks and should be considered as a standard in the natural hazards domain.
引用
收藏
页数:15
相关论文
共 52 条
[1]   A review of uncertainty quantification in deep learning: Techniques, applications and challenges [J].
Abdar, Moloud ;
Pourpanah, Farhad ;
Hussain, Sadiq ;
Rezazadegan, Dana ;
Liu, Li ;
Ghavamzadeh, Mohammad ;
Fieguth, Paul ;
Cao, Xiaochun ;
Khosravi, Abbas ;
Acharya, U. Rajendra ;
Makarenkov, Vladimir ;
Nahavandi, Saeid .
INFORMATION FUSION, 2021, 76 :243-297
[2]   Illustrative Discussion of MC-Dropout in General Dataset: Uncertainty Estimation in Bitcoin [J].
Alarab, Ismail ;
Prakoonwit, Simant ;
Nacer, Mohamed Ikbal .
NEURAL PROCESSING LETTERS, 2021, 53 (02) :1001-1011
[3]   Enhancement of Detecting Permanent Water and Temporary Water in Flood Disasters by Fusing Sentinel-1 and Sentinel-2 Imagery Using Deep Learning Algorithms: Demonstration of Sen1Floods11 Benchmark Datasets [J].
Bai, Yanbing ;
Wu, Wenqi ;
Yang, Zhengxin ;
Yu, Jinze ;
Zhao, Bo ;
Liu, Xing ;
Yang, Hanfang ;
Mas, Erick ;
Koshimura, Shunichi .
REMOTE SENSING, 2021, 13 (11) :NA
[4]   Sentinel-1-Based Water and Flood Mapping: Benchmarking Convolutional Neural Networks Against an Operational Rule-Based Processing Chain [J].
Bereczky, Max ;
Wieland, Marc ;
Krullikowski, Christian ;
Martinis, Sandro ;
Plank, Simon .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 :2023-2036
[5]  
Bischke B, 2018, INT GEOSCI REMOTE SE, P6191, DOI 10.1109/IGARSS.2018.8517836
[6]   Variational Inference: A Review for Statisticians [J].
Blei, David M. ;
Kucukelbir, Alp ;
McAuliffe, Jon D. .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2017, 112 (518) :859-877
[7]  
Blundell C., 2015, ARXIV, DOI DOI 10.48550/ARXIV.1505.05424
[8]   Sen1Floods11: a georeferenced dataset to train and test deep learning flood algorithms for Sentinel-1 [J].
Bonafilia, Derrick ;
Tellman, Beth ;
Anderson, Tyler ;
Issenberg, Erica .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :835-845
[9]  
Brosse N, 2020, PREPRINT
[10]  
Budde L.E., 2021, Int. Archives Photogrammetry, VXLIII-B2-2021, P441, DOI [10.5194/isprs-archives-xliii-b2-2021-441-2021, DOI 10.5194/ISPRS-ARCHIVES-XLIII-B2-2021-441, 10.5194/isprs, DOI 10.5194/ISPRS-ARCHIVES-XLIII-B2-2021-441-2021]