SenGLEAN: An End-to-End Deep Learning Approach for Super-Resolution of Sentinel-2 Multiresolution Multispectral Images

被引:0
|
作者
Gupta, Ayush [1 ]
Mishra, Rakesh [2 ]
Zhang, Yun [2 ]
机构
[1] Indian Inst Technol Kanpur, Dept Civil Engn, Kanpur 208016, India
[2] Univ New Brunswick, Dept Geodesy & Geomatics Engn, Fredericton, NB E3B 5A3, Canada
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
关键词
Spatial resolution; Task analysis; Remote sensing; Context modeling; Deep learning; Image reconstruction; Data models; Generative adversarial network (GAN); remote sensing; Sentinel-2; super-resolution (SR); SUPPORT;
D O I
10.1109/TGRS.2024.3374575
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Sentinel-2 data is highly valuable in remote sensing applications owing to its open accessibility and comprehensive spatial-temporal coverage. However, it poses a unique challenge due to its varying spatial resolutions across its different spectral bands (ranging from 10 to 60 m). High-resolution (HR) data offer finer details and significantly enhance the accuracy of analyses, benefiting a wide range of fields. The majority of current methods for enhancing Sentinel-2 image resolution do not address the enhancement of all bands through a unified network. To address this issue, we propose a novel deep learning-based solution named SenGLEAN, for enhancing multiresolution bands [specifically, 10- and 20-m ground sampling distance (GSD)] to a unified 5-m GSD. SenGLEAN leverages the concept of generative latent banks (GLEANs) and employs a multiresolution encoder-bank-decoder architecture to achieve high-resolution (HR) remote sensing imagery. Notably, our model incorporates channel-attention (CA) and pixel-attention (PA) modules within its design to enhance the spatial quality of results. Through quantitative comparison, we demonstrate that our network shows significant improvements, by increasing the PSNR by 0.28 dB for 10-m bands and 2.92 dB for 20-m bands while reducing the RMSE by 3.11 for 10-m bands and 52.26 for 20-m bands. Furthermore, we introduce a lightweight variant, LightSenGLEAN, retaining critical components while reducing total parameters by 81.89%, which still offers competitive performance. In summary, our proposed model provides an efficient solution to enhance both 10- and 20-m Sentinel-2 bands to 5-m resolution using a single deep learning framework, facilitating precise image analysis, and geoscience applications.
引用
收藏
页码:21 / 21
页数:1
相关论文
共 50 条
  • [1] Super-resolution of Sentinel-2 images: Learning a globally applicable deep neural network
    Lanaras, Charis
    Bioucas-Dias, Jose
    Galliani, Silvano
    Baltsavias, Emmanuel
    Schindler, Konrad
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 146 : 305 - 319
  • [2] End-to-End Learning of Video Super-Resolution with Motion Compensation
    Makansi, Osama
    Ilg, Eddy
    Brox, Thomas
    PATTERN RECOGNITION (GCPR 2017), 2017, 10496 : 203 - 214
  • [3] SplitSR: An End-to-End Approach to Super-Resolution on Mobile Devices
    Liu, Xin
    Li, Yuang
    Fromm, Josh
    Wang, Yuntao
    Jiang, Ziheng
    Mariakakis, Alex
    Patel, Shwetak
    PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2021, 5 (01):
  • [4] SUPER-RESOLUTION OF LARGE VOLUMES OF SENTINEL-2 IMAGES WITH HIGH PERFORMANCE DISTRIBUTED DEEP LEARNING
    Zhang, Run
    Cavallaro, Gabriele
    Jitsev, Jenia
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 617 - 620
  • [5] End-to-end snapshot compressed super-resolution imaging with deep optics
    Zhang, Bo
    Yuan, Xin
    Deng, Chao
    Zhang, Zhihong
    Suo, Jinli
    Dai, Qionghai
    OPTICA, 2022, 9 (04): : 451 - 454
  • [6] FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors
    Chen, Yu
    Tai, Ying
    Liu, Xiaoming
    Shen, Chunhua
    Yang, Jian
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 2492 - 2501
  • [7] End-to-End Learning for Joint Image Demosaicing, Denoising and Super-Resolution
    Xing, Wenzhu
    Egiazarian, Karen
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 3506 - 3515
  • [8] Deep learning-based harmonization and super-resolution of Landsat-8 and Sentinel-2 images
    Sambandham, Venkatesh Thirugnana
    Kirchheim, Konstantin
    Ortmeier, Frank
    Mukhopadhaya, Sayan
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2024, 212 : 274 - 288
  • [9] Deep-Learning Based Super-Resolution of Sentinel-2 Images for Monitoring Supercentenarian Olive Trees
    Panagiotopoulou, Antigoni
    Charou, Eleni
    Poirazidis, Konstantinos
    Voutos, Yorghos
    Martinis, Aristotelis
    Grammatikopoulos, Lazaros
    Petsa, Eleni
    Bratsolis, Emmanuel
    Mylonas, Phivos
    25TH PAN-HELLENIC CONFERENCE ON INFORMATICS WITH INTERNATIONAL PARTICIPATION (PCI2021), 2021, : 143 - 148
  • [10] AN APPROACH TO SUPER-RESOLUTION OF SENTINEL-2 IMAGES BASED ON GENERATIVE ADVERSARIAL NETWORKS
    Zhang, Kexin
    Sumbul, Gencer
    Demir, Begum
    2020 MEDITERRANEAN AND MIDDLE-EAST GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (M2GARSS), 2020, : 69 - 72