KappaMask: AI-Based Cloudmask Processor for Sentinel-2

被引:27
作者
Domnich, Marharyta [1 ,2 ]
Suenter, Indrek [1 ]
Trofimov, Heido [1 ]
Wold, Olga [1 ]
Harun, Fariha [1 ]
Kostiukhin, Anton [1 ]
Jaerveoja, Mihkel [1 ]
Veske, Mihkel [1 ]
Tamm, Tanel [1 ]
Voormansik, Kaupo [1 ,3 ]
Olesk, Aire [3 ]
Boccia, Valentina [4 ]
Longepe, Nicolas [4 ]
Cadau, Enrico Giuseppe [4 ]
机构
[1] KappaZeta Ltd, EE-51007 Tartu, Estonia
[2] Univ Tartu Estonia, Inst Comp Sci, EE-51009 Tartu, Estonia
[3] Univ Tartu, Tartu Observ, EE-61602 Toravere, Estonia
[4] ESA, European Space Agcy, ESRIN, Largo Galileo Galilei 1, I-00044 Frascati, RM, Italy
关键词
convolutional neural network; cloud mask; Sentinel-2; KappaMask; active learning; image segmentation; remote sensing; DETECTION ALGORITHM;
D O I
10.3390/rs13204100
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The Copernicus Sentinel-2 mission operated by the European Space Agency (ESA) provides comprehensive and continuous multi-spectral observations of all the Earth's land surface since mid-2015. Clouds and cloud shadows significantly decrease the usability of optical satellite data, especially in agricultural applications; therefore, an accurate and reliable cloud mask is mandatory for effective EO optical data exploitation. During the last few years, image segmentation techniques have developed rapidly with the exploitation of neural network capabilities. With this perspective, the KappaMask processor using U-Net architecture was developed with the ability to generate a classification mask over northern latitudes into the following classes: clear, cloud shadow, semi-transparent cloud (thin clouds), cloud and invalid. For training, a Sentinel-2 dataset covering the Northern European terrestrial area was labelled. KappaMask provides a 10 m classification mask for Sentinel-2 Level-2A (L2A) and Level-1C (L1C) products. The total dice coefficient on the test dataset, which was not seen by the model at any stage, was 80% for KappaMask L2A and 76% for KappaMask L1C for clear, cloud shadow, semi-transparent and cloud classes. A comparison with rule-based cloud mask methods was then performed on the same test dataset, where Sen2Cor reached 59% dice coefficient for clear, cloud shadow, semi-transparent and cloud classes, Fmask reached 61% for clear, cloud shadow and cloud classes and Maja reached 51% for clear and cloud classes. The closest machine learning open-source cloud classification mask, S2cloudless, had a 63% dice coefficient providing only cloud and clear classes, while KappaMask L2A, with a more complex classification schema, outperformed S2cloudless by 17%.
引用
收藏
页数:22
相关论文
共 26 条
[1]  
[Anonymous], 2016, L8 SPARCS CLOUD VALI
[2]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[3]   Validation of Copernicus Sentinel-2 Cloud Masks Obtained from MAJA, Sen2Cor, and FMask Processors Using Reference Cloud Masks Generated with a Supervised Active Learning Procedure [J].
Baetens, Louis ;
Desjardins, Camille ;
Hagolle, Olivier .
REMOTE SENSING, 2019, 11 (04)
[4]   Fast Cloud Segmentation Using Convolutional Neural Networks [J].
Droener, Johannes ;
Korfhage, Nikolaus ;
Egli, Sebastian ;
Muehling, Markus ;
Thies, Boris ;
Bendix, Joerg ;
Freisleben, Bernd ;
Seeger, Bernhard .
REMOTE SENSING, 2018, 10 (11)
[5]  
Fisher A, 2019, J MACH LEARN RES, V20
[6]   Cloud detection algorithm comparison and validation for operational Landsat data products [J].
Foga, Steve ;
Scaramuzza, Pat L. ;
Guo, Song ;
Zhu, Zhe ;
Dilley, Ronald D., Jr. ;
Beckmann, Tim ;
Schmidt, Gail L. ;
Dwyer, John L. ;
Hughes, M. Joseph ;
Laue, Brady .
REMOTE SENSING OF ENVIRONMENT, 2017, 194 :379-390
[7]  
Francis A., IRIS TOOLKIT
[8]  
Francis A., SENTINEL 2 CLOUD MAS
[9]  
Hagolle O., MAJA
[10]  
Hoffer E., 2017, Train longer, generalize better: closing the generalization gap in large batch training of neural networks