Unsupervised Sentinel-2 Image Fusion Using a Deep Unrolling Method

被引:0
|
作者
Nguyen, Han V. [1 ,2 ]
Ulfarsson, Magnus O. [1 ]
Sveinsson, Johannes R. [1 ]
Mura, Mauro Dalla [3 ,4 ]
机构
[1] Univ Iceland, Fac Elect & Comp Engn, IS-101 Reykjavik, Iceland
[2] Nha Trang Univ, Dept Elect & Elect Engn, Nha Trang 650000, Vietnam
[3] Univ Grenoble Alpes, Univ Grenoble Alpes Grenoble INP, CNRS, GIPSA Lab,Inst Engn, F-38000 Grenoble, France
[4] Inst Univ France IUF, F-75231 Paris, France
关键词
Image fusion; Sentinel-2; sharpening; superresolution; unrolling algorithm; unsupervised deep learning (DL); ALGORITHM; NETWORK;
D O I
10.1109/LGRS.2023.3326845
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Multispectral remote-sensing images often have band-dependent image resolution due to cost and technical limitations. To address this, we developed a method that sharpens low-resolution (LR) images using high-resolution (HR) images. In this letter, we propose a novel unsupervised deep-learning (DL) approach that involves unrolling an iterative algorithm into a deep neural network and training it using a loss function based on Stein's risk unbiased estimate (SURE) to sharpen the LR bands (20 and 60 m) of Sentinel-2 (S2) to their highest resolution (10 m). This approach views traditional optimization model-based methods through a DL framework, improving interpretability and clarifying connections between the two approaches. Results from both simulated and real S2 datasets demonstrate that the proposed method outperforms competitive methods and produces high-quality sharpened images for the 20- and 60-m bands. The codes are available at https://github.com/hvn2/S2-Unrolling.
引用
收藏
页码:1 / 5
页数:5
相关论文
共 50 条
  • [1] Sentinel-2 Image Fusion Using a Deep Residual Network
    Palsson, Frosti
    Sveinsson, Johannes R.
    Ulfarsson, Magnus O.
    REMOTE SENSING, 2018, 10 (08)
  • [2] RAPID MAPPING OF LANDSLIDES FROM SENTINEL-2 DATA USING UNSUPERVISED DEEP LEARNING
    Shahabi, H.
    Rahimzad, M.
    Ghorbanzadeh, O.
    Piralilou, S. T.
    Blaschke, T.
    Homayouni, S.
    Ghamisi, P.
    2022 IEEE MEDITERRANEAN AND MIDDLE-EAST GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (M2GARSS), 2022, : 17 - 20
  • [3] UNSUPERVISED IMAGE FUSION USING DEEP IMAGE PRIORS
    Ma, Xudong
    Hill, Paul
    Anantrasirichai, Nantheera
    Achim, Alin
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 2301 - 2305
  • [4] Unsupervised deep learning based change detection in Sentinel-2 images
    Saha, Sudipan
    Solano-Correa, Yady Tatiana
    Bovolo, Francesca
    Bruzzone, Lorenzo
    2019 10TH INTERNATIONAL WORKSHOP ON THE ANALYSIS OF MULTITEMPORAL REMOTE SENSING IMAGES (MULTITEMP), 2019,
  • [5] Burnt Forest Estimation from Sentinel-2 Imagery of Australia using Unsupervised Deep Learning
    Abid, Nosheen
    Malik, Muhammad Imran
    Shahzad, Muhammad
    Shafait, Faisal
    Ali, Haider
    Ghaffar, Muhammad Mohsin
    Weis, Christian
    Wehn, Norbert
    Liwicki, Marcus
    2021 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA 2021), 2021, : 74 - 81
  • [6] Fusion of Sentinel-2 images
    Wang, Qunming
    Shi, Wenzhong
    Li, Zhongbin
    Atkinson, Peter M.
    REMOTE SENSING OF ENVIRONMENT, 2016, 187 : 241 - 252
  • [7] Unsupervised self-training method based on deep learning for soil moisture estimation using synergy of sentinel-1 and sentinel-2 images
    Ben Abbes, Ali
    Jarray, Noureddine
    INTERNATIONAL JOURNAL OF IMAGE AND DATA FUSION, 2023, 14 (01) : 1 - 14
  • [8] An unsupervised domain adaptation deep learning method for spatial and temporal transferable crop type mapping using Sentinel-2 imagery
    Wang, Yumiao
    Feng, Luwei
    Zhang, Zhou
    Tian, Feng
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 199 : 102 - 117
  • [9] Unsupervised Deep Learning for Landslide Detection from Multispectral Sentinel-2 Imagery
    Shahabi, Hejar
    Rahimzad, Maryam
    Piralilou, Sepideh Tavakkoli
    Ghorbanzadeh, Omid
    Homayouni, Saied
    Blaschke, Thomas
    Lim, Samsung
    Ghamisi, Pedram
    REMOTE SENSING, 2021, 13 (22)
  • [10] DEEP LEARNING FOR THE CLASSIFICATION OF SENTINEL-2 IMAGE TIME SERIES
    Pelletier, Charlotte
    Webb, Geoffrey I.
    Petitjean, Francois
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 461 - 464