A comprehensive review on deep learning based remote sensing image super-resolution methods

被引:187
作者
Wang, Peijuan [1 ]
Bayram, Bulent [2 ]
Sertel, Elif [3 ]
机构
[1] Istanbul Tech Univ, Inst Informat, Istanbul, Turkey
[2] Yildiz Tech Univ, Dept Geomat Engn, Istanbul, Turkey
[3] Istanbul Tech Univ, Dept Geomat Engn, Istanbul, Turkey
关键词
Deep learning; Remote sensing; Super-resolution; CONVOLUTIONAL NETWORK; NEURAL-NETWORK;
D O I
10.1016/j.earscirev.2022.104110
中图分类号
P [天文学、地球科学];
学科分类号
07 ;
摘要
Satellite imageries are an important geoinformation source for different applications in the Earth Science field. However, due to the limitation of the optic and sensor technologies and the high cost to update the sensors and equipments, the spectral and spatial resolution of the Earth Observation satellites may not meet the desired requirements. Thus, Remote Sensing Image Super-resolution (RSISR) which aims at restoring the high-resolution (HR) remote sensing images from the given low-resolution (LR) images has drawn considerable attention and witnessed the rapid development of the deep learning (DL) algorithms. In this research, we aim to compre-hensively review the DL-based single image super-resolution (SISR) methods on optical remote sensing images. First, we introduce the DL techniques utilized in SISR. Second, we summarize the RSISR algorithms thoroughly, including the DL models, commonly used remote sensing datasets, loss functions, and performance evaluation metrics. Third, we present a new multi-sensor dataset that consists of Very High-Resolution satellite images from different satellites of various landscapes and evaluate the performance of some state-of-the-art super-resolution methods on this dataset. Finally, we envision the challenges and future research in the RSISR field.
引用
收藏
页数:25
相关论文
共 146 条
[1]   Image Super-resolution via Progressive Cascading Residual Network [J].
Ahn, Namhyuk ;
Kang, Byungkon ;
Sohn, Kyung-Ah .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :904-912
[2]   Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network [J].
Ahn, Namhyuk ;
Kang, Byungkon ;
Sohn, Kyung-Ah .
COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 :256-272
[3]   Multispectral and panchromatic data fusion assessment without reference [J].
Alparone, Luciano ;
Alazzi, Bruno ;
Baronti, Stefano ;
Garzelli, Andrea ;
Nencini, Filippo ;
Selva, Massimo .
PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2008, 74 (02) :193-200
[4]  
[Anonymous], 2016, KAGGLE OPEN SOURCE D
[5]  
[Anonymous], 2019, DATA FUSION CONTEST
[6]   A Deep Journey into Super-resolution: A Survey [J].
Anwar, Saeed ;
Khan, Salman ;
Barnes, Nick .
ACM COMPUTING SURVEYS, 2020, 53 (03)
[7]  
AWS) S. on A.W.S, 2018, DAT
[8]   The 2018 PIRM Challenge on Perceptual Image Super-Resolution [J].
Blau, Yochai ;
Mechrez, Roey ;
Timofte, Radu ;
Michaeli, Tomer ;
Zelnik-Manor, Lihi .
COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 :334-355
[9]   Bidirectional Convolutional LSTM Neural Network for Remote Sensing Image Super-Resolution [J].
Chang, Yunpeng ;
Luo, Bin .
REMOTE SENSING, 2019, 11 (20)
[10]  
Chen AX, 2018, IEEE IJCNN