Snow Avalanche Segmentation in SAR Images With Fully Convolutional Neural Networks

被引:36
作者
Bianchi, Filippo Maria [1 ,2 ]
Grahn, Jakob [2 ]
Eckerstorfer, Markus [2 ]
Malnes, Eirik [2 ]
Vickers, Hannah [2 ]
机构
[1] UiT Arctic Univ Norway, Dept Math & Stat, N-9019 Tromso, Norway
[2] NORCE Norwegian Res Ctr AS, N-5008 Bergen, Norway
关键词
Synthetic aperture radar; Image segmentation; Peak to average power ratio; Deep learning; Snow; Radar imaging; Backscatter; Convolutional neural networks (CNNs); deep learning; saliency segmentation; Sentinel-1 (S1); snow avalanches; synthetic aperture radar (SAR);
D O I
10.1109/JSTARS.2020.3036914
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Knowledge about frequency and location of snow avalanche activity is essential for forecasting and mapping of snow avalanche hazard. Traditional field monitoring of avalanche activity has limitations, especially when surveying large and remote areas. In recent years, avalanche detection in Sentinel-1 radar satellite imagery has been developed to improve monitoring. However, the current state-of-the-art detection algorithms, based on radar signal processing techniques, are still much less accurate than human experts. To reduce this gap, we propose a deep learning architecture for detecting avalanches in Sentinel-1 radar images. We trained a neural network on 6345 manually labeled avalanches from 117 Sentinel-1 images, each one consisting of six channels that include backscatter and topographical information. Then, we tested our trained model on a new synthetic aperture radar image. Comparing to the manual labeling (the gold standard), we achieved an F1 score above 66%, whereas the state-of-the-art detection algorithm sits at an F1 score of only 38%. A visual inspection of the results generated by our deep learning model shows that only small avalanches are undetected, whereas some avalanches that were originally not labeled by the human expert are discovered.
引用
收藏
页码:75 / 82
页数:8
相关论文
共 25 条
[1]  
Bakkehoi S., 1983, Annals of Glaciology, V4, P24
[2]   The Lovasz-Softmax loss: A tractable surrogate for the optimization of the intersection-over-union measure in neural networks [J].
Berman, Maxim ;
Triki, Amal Rannen ;
Blaschko, Matthew B. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :4413-4421
[3]   Large-Scale Detection and Categorization of Oil Spills from SAR Images with Deep Learning [J].
Bianchi, Filippo Maria ;
Espeseth, Martine M. ;
Borch, Njal .
REMOTE SENSING, 2020, 12 (14)
[4]  
Chen L.-C., 2018, PROC EUR C COMPUT VI, P833, DOI [10.1007/978-3-030-01234-2_49, DOI 10.1007/978-3-030-01234-2_49]
[5]   What is a good evaluation measure for semantic segmentation? [J].
Csurka, Gabriela ;
Larlus, Diane ;
Perronnin, Florent .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2013, 2013,
[6]   Statistical runout modeling of snow avalanches using GIS in Glacier National Park, Canada [J].
Delparte, D. ;
Jamieson, B. ;
Waters, N. .
COLD REGIONS SCIENCE AND TECHNOLOGY, 2008, 54 (03) :183-192
[7]   A complete snow avalanche activity record from a Norwegian forecasting region using Sentinel-1 satellite-radar data [J].
Eckerstorfer, M. ;
Malnes, E. ;
Mueller, K. .
COLD REGIONS SCIENCE AND TECHNOLOGY, 2017, 144 :39-51
[8]  
Jones A, 2011, P 5 CAN C GEOT NAT, V49, P1309
[9]   Urban Land Cover Classification With Missing Data Modalities Using Deep Convolutional Neural Networks [J].
Kampffmeyer, Michael ;
Salberg, Arnt-Borre ;
Jenssen, Robert .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (06) :1758-1768
[10]   Semantic Segmentation of Small Objects and Modeling of Uncertainty in Urban Remote Sensing Images Using Deep Convolutional Neural Networks [J].
Kampffmeyer, Michael ;
Salberg, Arnt-Borre ;
Jenssen, Robert .
PROCEEDINGS OF 29TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, (CVPRW 2016), 2016, :680-688