Using Super-Resolution Algorithms for Small Satellite Imagery: A Systematic Review

被引:17
作者
Karwowska, Kinga [1 ]
Wierzbicki, Damian [1 ]
机构
[1] Mil Univ Technol, Fac Civil Engn & Geodesy, Dept Imagery Intelligence, PL-00908 Warsaw, Poland
关键词
Spatial resolution; Interpolation; Imaging; Small satellites; Digital images; Superresolution; Pansharpening; Convolutional neural networks; deep learning; neural networks; single image super-resolution (SISR); super-; resolution; PAN-SHARPENING METHOD; HIGH-RESOLUTION SAR; LANDSAT TM; FUSION TECHNIQUES; SPOT-5; IHS; CLASSIFICATION; COVER;
D O I
10.1109/JSTARS.2022.3167646
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In recent years, we have witnessed significant development in the space sector, in particular regarding Earth imaging. Small satellites, whose size and construction make their production much cheaper, are becoming increasingly popular. As a result, a larger number of satellites may be placed in space, and thus, they may perform more frequent observations of selected spots on Earth. Unfortunately, the construction of these satellites also affects their observation capacity as they have a weaker spatial resolution. Scientists have been dealing with the problem of improving the spatial resolution of satellite imaging for many years. Numerous methods were developed that allow for the best possible representation of high-resolution images based on low-resolution images. However, the application of traditional solutions to improve the resolution of digital images requires an additional high-resolution image. As far as images obtained by small satellites (e.g., nano, micro, or mini) are concerned, the difference between the spatial resolution of panchromatic and multispectral images is small (e.g., for SkySat-3 - SkySat-15 satellites, it is only 0.16 m). The need to increase the spatial resolution of an image that does not have a corresponding higher resolution image (e.g., a panchromatic image or a sequence of images) causes additional problems. This article presents a review of the methods to improve the spatial resolution of small-satellite imaging. The authors analyze the interpolation, pansharpening, and digital image processing methods. Additionally, the article focuses on presenting solutions based on deep learning that enables the enhancement of the spatial resolution of images obtained from small satellites. The methodology of creating databases used for network training is described. Finally, the authors present the main limitations of the analyzed solutions and future development trends that will enable to improve the spatial resolution with the use of a single image.
引用
收藏
页码:3292 / 3312
页数:21
相关论文
共 186 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]   Convolutional Neural Networks Using Skip Connections with Layer Groups for Super-Resolution Image Reconstruction Based on Deep Learning [J].
Ahn, Hyeongyeom ;
Yim, Changhoon .
APPLIED SCIENCES-BASEL, 2020, 10 (06)
[3]  
Aila T., 2019, STYLE BASED GENERATO
[4]   Fusing high-resolution SAR and optical imagery for improved urban land cover study and classification [J].
Amarsaikhan, D. ;
Blotevogel, H. H. ;
van Genderen, J. L. ;
Ganzorig, M. ;
Gantuya, R. ;
Nergui, B. .
INTERNATIONAL JOURNAL OF IMAGE AND DATA FUSION, 2010, 1 (01) :83-97
[5]  
Anderson J, 1991, Photogramm. Eng. Remote Sens, V57, P265
[6]   Estimation of tropical forest structure from SPOT-5 satellite images [J].
Angel Castillo-Santiago, Miguel ;
Ricker, Martin ;
de Jong, Bernardus H. J. .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2010, 31 (10) :2767-2782
[7]  
[Anonymous], ACCELERATING SUPER R
[8]  
[Anonymous], 1983, INT S REM SENS ENV
[9]  
[Anonymous], 2016, Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network
[10]  
Belov A. M., 2019, Journal of Physics: Conference Series, V1368, DOI 10.1088/1742-6596/1368/3/032006