Deep Learning for Downscaling Remote Sensing Images: Fusion and Super-Resolution

被引:32
作者
Sdraka, Maria [1 ]
Papoutsis, Ioannis [1 ,2 ,3 ]
Psomas, Bill [4 ,5 ,6 ]
Vlachos, Konstantinos [7 ]
Ioannidis, Konstantinos [7 ,8 ]
Karantzalos, Konstantinos [9 ,10 ]
Gialampoukidis, Ilias [7 ]
Vrochidis, Stefanos [7 ,8 ]
机构
[1] Natl Observ Athens, Inst Astron Astrophys Space Applicat & Remote Sen, Athens 15236, Greece
[2] Natl Observ Athens, OrionLab, Athens 15236, Greece
[3] European Space Agcy Hubs Distribute Sentinel Data, Greek Node, Athens, Greece
[4] Natl Tech Univ Athens, Athens, Greece
[5] Inria Rennes Bretagne Atlantique, Rennes, France
[6] Athena Res Ctr, Athens, Greece
[7] Ctr Res & Technol Hellas, Informat Technol Inst, Thessaloniki 57001, Greece
[8] Multimedia Knowledge & Social Media Analyt Lab, Multimodal Data Fus & Analyt M4D Grp, Athens, Greece
[9] Ecole Cent Paris, Dept Appl Math, Gif Sur Yvette, France
[10] Natl Tech Univ Athens, Remote Sensing, Athens 15780, Greece
基金
欧盟地平线“2020”;
关键词
Spatial resolution; Feature extraction; Image sensors; PSNR; Loss measurement; Indexes; Deep learning; CONVOLUTIONAL NEURAL-NETWORK; QUALITY ASSESSMENT; SPATIOTEMPORAL FUSION; DETAIL INJECTION; SATELLITE IMAGES; RECONSTRUCTION; INFORMATION; ATTENTION; LANDSAT; NET;
D O I
10.1109/MGRS.2022.3171836
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The past few years have seen an accelerating integration of deep learning (DL) techniques into various remote sensing (RS) applications, highlighting their power to adapt and achieving unprecedented advancements. In the present review, we provide an exhaustive exploration of the DL approaches proposed specifically for the spatial downscaling of RS imagery. A key contribution of our work is the presentation of the major architectural components and models, metrics, and data sets available for this task as well as the construction of a compact taxonomy for navigating through the various methods. Furthermore, we analyze the limitations of the current modeling approaches and provide a brief discussion on promising directions for image enhancement, following the paradigm of general computer vision (CV) practitioners and researchers as a source of inspiration and constructive insight. © 2013 IEEE.
引用
收藏
页码:202 / 255
页数:54
相关论文
共 249 条
  • [1] Multispectral and panchromatic data fusion assessment without reference
    Alparone, Luciano
    Alazzi, Bruno
    Baronti, Stefano
    Garzelli, Andrea
    Nencini, Filippo
    Selva, Massimo
    [J]. PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2008, 74 (02) : 193 - 200
  • [2] [Anonymous], LANDS 8
  • [3] [Anonymous], WEB SCI
  • [4] [Anonymous], SENTINEL 2 OVERVIEW
  • [5] [Anonymous], DRAP SAT IM CHRON
  • [6] [Anonymous], MODIS TECHN SPEC
  • [7] Dialectical GAN for SAR Image Translation: From Sentinel-1 to TerraSAR-X
    Ao, Dongyang
    Dumitru, Corneliu Octavian
    Schwarz, Gottfried
    Datcu, Mihai
    [J]. REMOTE SENSING, 2018, 10 (10)
  • [8] Multi-Image Super-Resolution for Remote Sensing using Deep Recurrent Networks
    Arefin, Md Rifat
    Michalski, Vincent
    St-Charles, Pierre-Luc
    Kalaitzis, Alfredo
    Kim, Sookyung
    Kahou, Samira E.
    Bengio, Yoshua
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 816 - 825
  • [9] Spatial Super Resolution of Real-World Aerial Images for Image-Based Plant Phenotyping
    Aslahishahri, Masoomeh
    Stanley, Kevin G.
    Duddu, Hema
    Shirtliffe, Steve
    Vail, Sally
    Stavness, Ian
    [J]. REMOTE SENSING, 2021, 13 (12)
  • [10] Downscaling in remote sensing
    Atkinson, Peter M.
    [J]. INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2013, 22 : 106 - 114