Reconstructing Snow-Free Sentinel-2 Satellite Imagery: A Generative Adversarial Network (GAN) Approach

被引:2
作者
Oluwadare, Temitope Seun [1 ]
Chen, Dongmei [1 ]
Oluwafemi, Olawale [2 ]
Babadi, Masoud [1 ]
Hossain, Mohammad [1 ]
Ibukun, Oluwaseun [2 ]
机构
[1] Queens Univ, Geog Informat & Spatial Anal Lab, Kingston, ON K7L 3N6, Canada
[2] Univ Toledo, Dept Geog & Planning, Toledo, OH 43606 USA
基金
加拿大自然科学与工程研究理事会;
关键词
Sentinel-2; satellite imagery; remote sensing; deep learning; GAN; snow remover; CLOUD REMOVAL;
D O I
10.3390/rs16132352
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Sentinel-2 satellites are one of the major instruments in remote sensing (RS) technology that has revolutionized Earth observation research, as its main goal is to offer high-resolution satellite data for dynamic monitoring of Earth's surface and climate change detection amongst others. However, visual observation of Sentinel-2 satellite data has revealed that most images obtained during the winter season contain snow noise, posing a major challenge and impediment to satellite RS analysis of land surface. This singular effect hampers satellite signals from capturing important surface features within the geographical area of interest. Consequently, it leads to information loss, image processing problems due to contamination, and masking effects, all of which can reduce the accuracy of image analysis. In this study, we developed a snow-cover removal (SCR) model based on the Cycle-Consistent Adversarial Networks (CycleGANs) architecture. Data augmentation procedures were carried out to salvage the effect of the limited availability of Sentinel-2 image data. Sentinel-2 satellite images were used for model training and the development of a novel SCR model. The SCR model captures snow and other prominent features in the Sentinel-2 satellite image and then generates a new snow-free synthetic optical image that shares the same characteristics as the source satellite image. The snow-free synthetic images generated are evaluated to quantify their visual and semantic similarity with original snow-free Sentinel-2 satellite images by using different image qualitative metrics (IQMs) such as Structural Similarity Index Measure (SSIM), Universal image quality index (Q), and peak signal-to-noise ratio (PSNR). The estimated metric data shows that Q delivers more metric values, nearly 95%, than SSIM and PRSN. The methodology presented in this study could be beneficial for RS research in DL model development for environmental mapping and time series modeling. The results also confirm the DL technique's applicability in RS studies.
引用
收藏
页数:15
相关论文
共 38 条
[1]  
Abdelhack M, 2020, Arxiv, DOI arXiv:2003.13502
[2]  
Chandhok S., 2022, CycleGAN: Unpaired Image-to-Image Translation (Part 1)
[3]   Cloud Removal in Remote Sensing Images Using Generative Adversarial Networks and SAR-to-Optical Image Translation [J].
Darbaghshahi, Faramarz Naderi ;
Mohammadi, Mohammad Reza ;
Soryani, Mohsen .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[4]  
Deepthi N., 2016, IOSR J. Electr. Electron. Eng, V11, P25
[5]   Filmy Cloud Removal on Satellite Imagery with Multispectral Conditional Generative Adversarial Nets [J].
Enomoto, Kenji ;
Sakurada, Ken ;
Wang, Weimin ;
Fukui, Hiroshi ;
Matsuoka, Masashi ;
Nakamura, Ryosuke ;
Kawaguchi, Nobuo .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1533-1541
[6]   Theia Snow collection: high-resolution operational snow cover maps from Sentinel-2 and Landsat-8 data [J].
Gascoin, Simon ;
Grizonnet, Manuel ;
Bouchet, Marine ;
Salgues, Germain ;
Hagolle, Olivier .
EARTH SYSTEM SCIENCE DATA, 2019, 11 (02) :493-514
[7]   Generative Adversarial Networks [J].
Goodfellow, Ian ;
Pouget-Abadie, Jean ;
Mirza, Mehdi ;
Xu, Bing ;
Warde-Farley, David ;
Ozair, Sherjil ;
Courville, Aaron ;
Bengio, Yoshua .
COMMUNICATIONS OF THE ACM, 2020, 63 (11) :139-144
[8]   Cloud Removal From Optical Satellite Imagery With SAR Imagery Using Sparse Representation [J].
Huang, Bo ;
Li, Ying ;
Han, Xiaoyu ;
Cui, Yuanzheng ;
Li, Wenbo ;
Li, Rongrong .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2015, 12 (05) :1046-1050
[9]   Image-to-Image Translation with Conditional Adversarial Networks [J].
Isola, Phillip ;
Zhu, Jun-Yan ;
Zhou, Tinghui ;
Efros, Alexei A. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5967-5976
[10]   Single-Image Snow Removal Based on an Attention Mechanism and a Generative Adversarial Network [J].
Jia, Aiwen ;
Jia, Zhen-Hong ;
Yang, Jie ;
Kasabov, Nikola K. .
IEEE ACCESS, 2021, 9 :12852-12860