Arbitrary-scale Super-resolution via Deep Learning: A Comprehensive Survey

被引:5
|
作者
Liu, Hongying [1 ]
Li, Zekun [2 ]
Shang, Fanhua [3 ]
Liu, Yuanyuan [2 ]
Wan, Liang [1 ,3 ]
Feng, Wei [3 ]
Timofte, Radu [4 ,5 ]
机构
[1] Tianjin Univ, Med Coll, Tianjin 300072, Peoples R China
[2] Xidian Univ, Sch Artificial Intelligence, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian 710071, Peoples R China
[3] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China
[4] Swiss Fed Inst Technol, Zurich, Switzerland
[5] Univ Wurzburg, CAIDAS & IFI, Comp Vis Lab, Wurzburg, Germany
关键词
Image super-resolution; Video super-resolution; Arbitrary scale; Deep learning; SINGLE IMAGE SUPERRESOLUTION; NETWORK; VIDEO;
D O I
10.1016/j.inffus.2023.102015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Super -resolution (SR) is an essential class of low-level vision tasks, which aims to improve the resolution of images or videos in computer vision. In recent years, significant progress has been made in image and video super -resolution techniques based on deep learning. Nevertheless, most of the methods only consider SR with a few integer scale factors, which limits the application of the SR techniques to real -world problems. Recently, the methods to achieve arbitrary -scale super -resolution via a single model have attracted much attention. However, there is no work to thoroughly analyze the arbitrary -scale methods based on deep learning. In this work, we present a comprehensive and systematic review of 45 existing deep learning -based methods for arbitrary -scale image and video SR. We first classify the existing SR methods according to the resolved scale factors. Furthermore, we propose an in-depth taxonomy for state-of-the-art methods based on the core problem of how to achieve arbitrary -scale super -resolution, i.e., how to perform arbitrary -scale upsampling. Moreover, the performance of existing arbitrary -scale SR methods is compared, and their advantages and limitations are analyzed. We also provide some guidance for the selection of these methods in different real -world applications. Finally, we briefly discuss the future directions of arbitrary -scale super -resolution, which shows some inspirations for the progress of subsequent works on arbitrary -scale image and video super -resolution tasks. The repository of this work is available at https://github.com/Weepingchestnut/Arbitrary-Scale-SR.
引用
收藏
页数:26
相关论文
共 50 条
  • [31] Synergizing frequency domain and texture-aware implicit module for MRI arbitrary-scale super-resolution
    Tu, Xinyue
    Li, Guangyuan
    Liu, Yuanxing
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 98
  • [32] Spatial-Frequency Fusion for Arbitrary-Scale Ultra-High-Definition Image Super-Resolution
    Yang, Cuixin
    Xiao, Jun
    Lam, Kin-Man
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY, IWAIT 2024, 2024, 13164
  • [33] ASDN: A Deep Convolutional Network for Arbitrary Scale Image Super-Resolution
    Shen, Jialiang
    Wang, Yucheng
    Zhang, Jian
    MOBILE NETWORKS & APPLICATIONS, 2021, 26 (01): : 13 - 26
  • [34] ASDN: A Deep Convolutional Network for Arbitrary Scale Image Super-Resolution
    Jialiang Shen
    Yucheng Wang
    Jian Zhang
    Mobile Networks and Applications, 2021, 26 : 13 - 26
  • [35] Deep learning for medical imaging super-resolution: A comprehensive review
    Xiao, Hanguang
    Yang, Zhiying
    Liu, Tianqi
    Liu, Shihong
    Huang, Xiaoxuan
    Dai, Jiahui
    NEUROCOMPUTING, 2025, 630
  • [36] Super-resolution for biometrics: A comprehensive survey
    Kien Nguyen
    Fookes, Clinton
    Sridharan, Sridha
    Tistarelli, Massimo
    Nixon, Mark
    PATTERN RECOGNITION, 2018, 78 : 23 - 42
  • [37] Arbitrary Scale Super-Resolution for Medical Images
    Zhu, Jin
    Tan, Chuan
    Yang, Junwei
    Yang, Guang
    Lio, Pietro
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2021, 31 (10)
  • [38] Memory-Efficient Discrete Cosine Transform Domain Weight Modulation Transformer for Arbitrary-Scale Super-Resolution
    Kim, Min Hyuk
    Yoo, Seok Bong
    MATHEMATICS, 2023, 11 (18)
  • [39] A brief survey on deep learning based image super-resolution
    祝晓斌
    Li Shanshan
    Wang Lei
    High Technology Letters, 2021, 27 (03) : 294 - 302
  • [40] Deep Learning Based Single Image Super-resolution: A Survey
    Viet Khanh Ha
    Jin-Chang Ren
    Xin-Ying Xu
    Sophia Zhao
    Gang Xie
    Valentin Masero
    Amir Hussain
    International Journal of Automation and Computing, 2019, 16 : 413 - 426