A Review of Image Super-Resolution Approaches Based on Deep Learning and Applications in Remote Sensing

被引:55
作者
Wang, Xuan [1 ]
Yi, Jinglei [1 ]
Guo, Jian [1 ]
Song, Yongchao [1 ]
Lyu, Jun [1 ]
Xu, Jindong [1 ]
Yan, Weiqing [1 ]
Zhao, Jindong [1 ]
Cai, Qing [2 ,3 ]
Min, Haigen [4 ,5 ]
机构
[1] Yantai Univ, Sch Comp & Control Engn, Yantai 264005, Peoples R China
[2] Chinese Univ Hong Kong, Sch Data Sci, Shenzhen 518172, Peoples R China
[3] Univ Sci & Technol China, Sch Informat Sci & Technol, Hefei 230026, Peoples R China
[4] Changan Univ, Sch Informat Engn, Xian 710064, Peoples R China
[5] China Mobile Commun Corp, Joint Lab Internet Vehicles, Minist Educ, Xian 710064, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
image super-resolution; deep learning; remote sensing; model design; evaluation methods; BACK-PROJECTION NETWORKS; QUALITY ASSESSMENT; SUPER RESOLUTION; REPRESENTATION;
D O I
10.3390/rs14215423
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
At present, with the advance of satellite image processing technology, remote sensing images are becoming more widely used in real scenes. However, due to the limitations of current remote sensing imaging technology and the influence of the external environment, the resolution of remote sensing images often struggles to meet application requirements. In order to obtain high-resolution remote sensing images, image super-resolution methods are gradually being applied to the recovery and reconstruction of remote sensing images. The use of image super-resolution methods can overcome the current limitations of remote sensing image acquisition systems and acquisition environments, solving the problems of poor-quality remote sensing images, blurred regions of interest, and the requirement for high-efficiency image reconstruction, a research topic that is of significant relevance to image processing. In recent years, there has been tremendous progress made in image super-resolution methods, driven by the continuous development of deep learning algorithms. In this paper, we provide a comprehensive overview and analysis of deep-learning-based image super-resolution methods. Specifically, we first introduce the research background and details of image super-resolution techniques. Second, we present some important works on remote sensing image super-resolution, such as training and testing datasets, image quality and model performance evaluation methods, model design principles, related applications, etc. Finally, we point out some existing problems and future directions in the field of remote sensing image super-resolution.
引用
收藏
页数:34
相关论文
共 151 条
  • [1] State-of-the-art in artificial neural network applications: A survey
    Abiodun, Oludare Isaac
    Jantan, Aman
    Omolara, Abiodun Esther
    Dada, Kemi Victoria
    Mohamed, Nachaat AbdElatif
    Arshad, Humaira
    [J]. HELIYON, 2018, 4 (11)
  • [2] NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study
    Agustsson, Eirikur
    Timofte, Radu
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1122 - 1131
  • [3] Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Network
    Ahn, Namhyuk
    Kang, Byungkon
    Sohn, Kyung-Ah
    [J]. COMPUTER VISION - ECCV 2018, PT X, 2018, 11214 : 256 - 272
  • [4] Contour Detection and Hierarchical Image Segmentation
    Arbelaez, Pablo
    Maire, Michael
    Fowlkes, Charless
    Malik, Jitendra
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (05) : 898 - 916
  • [5] Multi-Image Super-Resolution for Remote Sensing using Deep Recurrent Networks
    Arefin, Md Rifat
    Michalski, Vincent
    St-Charles, Pierre-Luc
    Kalaitzis, Alfredo
    Kim, Sookyung
    Kahou, Samira E.
    Bengio, Yoshua
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 816 - 825
  • [6] Ben Niu, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12357), P191, DOI 10.1007/978-3-030-58610-2_12
  • [7] Representation Learning: A Review and New Perspectives
    Bengio, Yoshua
    Courville, Aaron
    Vincent, Pascal
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (08) : 1798 - 1828
  • [8] Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding
    Bevilacqua, Marco
    Roumy, Aline
    Guillemot, Christine
    Morel, Marie-Line Alberi
    [J]. PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
  • [9] The 2018 PIRM Challenge on Perceptual Image Super-Resolution
    Blau, Yochai
    Mechrez, Roey
    Timofte, Radu
    Michaeli, Tomer
    Zelnik-Manor, Lihi
    [J]. COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 : 334 - 355
  • [10] Cai Q., 2022, ARXIV