Arbitrary-scale Super-resolution via Deep Learning: A Comprehensive Survey

被引:5
|
作者
Liu, Hongying [1 ]
Li, Zekun [2 ]
Shang, Fanhua [3 ]
Liu, Yuanyuan [2 ]
Wan, Liang [1 ,3 ]
Feng, Wei [3 ]
Timofte, Radu [4 ,5 ]
机构
[1] Tianjin Univ, Med Coll, Tianjin 300072, Peoples R China
[2] Xidian Univ, Sch Artificial Intelligence, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian 710071, Peoples R China
[3] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China
[4] Swiss Fed Inst Technol, Zurich, Switzerland
[5] Univ Wurzburg, CAIDAS & IFI, Comp Vis Lab, Wurzburg, Germany
关键词
Image super-resolution; Video super-resolution; Arbitrary scale; Deep learning; SINGLE IMAGE SUPERRESOLUTION; NETWORK; VIDEO;
D O I
10.1016/j.inffus.2023.102015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Super -resolution (SR) is an essential class of low-level vision tasks, which aims to improve the resolution of images or videos in computer vision. In recent years, significant progress has been made in image and video super -resolution techniques based on deep learning. Nevertheless, most of the methods only consider SR with a few integer scale factors, which limits the application of the SR techniques to real -world problems. Recently, the methods to achieve arbitrary -scale super -resolution via a single model have attracted much attention. However, there is no work to thoroughly analyze the arbitrary -scale methods based on deep learning. In this work, we present a comprehensive and systematic review of 45 existing deep learning -based methods for arbitrary -scale image and video SR. We first classify the existing SR methods according to the resolved scale factors. Furthermore, we propose an in-depth taxonomy for state-of-the-art methods based on the core problem of how to achieve arbitrary -scale super -resolution, i.e., how to perform arbitrary -scale upsampling. Moreover, the performance of existing arbitrary -scale SR methods is compared, and their advantages and limitations are analyzed. We also provide some guidance for the selection of these methods in different real -world applications. Finally, we briefly discuss the future directions of arbitrary -scale super -resolution, which shows some inspirations for the progress of subsequent works on arbitrary -scale image and video super -resolution tasks. The repository of this work is available at https://github.com/Weepingchestnut/Arbitrary-Scale-SR.
引用
收藏
页数:26
相关论文
共 50 条
  • [41] Deep Learning-based Face Super-resolution: A Survey
    Jiang, Junjun
    Wang, Chenyang
    Liu, Xianming
    Ma, Jiayi
    ACM COMPUTING SURVEYS, 2023, 55 (01)
  • [42] A brief survey on deep learning based image super-resolution
    Zhu X.
    Li S.
    Wang L.
    High Technology Letters, 2021, 27 (03) : 294 - 302
  • [43] Deep Learning Based Single Image Super-resolution: A Survey
    Viet Khanh Ha
    Ren, Jin-Chang
    Xu, Xin-Ying
    Zhao, Sophia
    Xie, Gang
    Masero, Valentin
    Hussain, Amir
    INTERNATIONAL JOURNAL OF AUTOMATION AND COMPUTING, 2019, 16 (04) : 413 - 426
  • [44] Deep Learning Based Single Image Super-Resolution: A Survey
    Khanh Ha, Viet
    Ren, Jinchang
    Xu, Xinying
    Zhao, Sophia
    Xie, Gang
    Masero Vargas, Valentin
    ADVANCES IN BRAIN INSPIRED COGNITIVE SYSTEMS, BICS 2018, 2018, 10989 : 106 - 119
  • [45] Deep Learning Based Single Image Super-resolution:A Survey
    Viet Khanh Ha
    Jin-Chang Ren
    Xin-Ying Xu
    Sophia Zhao
    Gang Xie
    Valentin Masero
    Amir Hussain
    International Journal of Automation and Computing, 2019, (04) : 413 - 426
  • [46] A Deep Journey into Super-resolution: A Survey
    Anwar, Saeed
    Khan, Salman
    Barnes, Nick
    ACM COMPUTING SURVEYS, 2020, 53 (03)
  • [47] DuDoINet: Dual-Domain Implicit Network for Multi-Modality MR Image Arbitrary-scale Super-Resolution
    Li, Guangyuan
    Xing, Wei
    Zhao, Lei
    Lan, Zehua
    Zhang, Zhanjie
    Sun, Jiakai
    Yin, Haolin
    Lin, Huaizhong
    Lin, Zhijie
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 7335 - 7344
  • [48] Deep learning for image super-resolution
    Yang, Wenming
    Zhou, Fei
    Zhu, Rui
    Fukui, Kazuhiro
    Wang, Guijin
    Xue, Jing-Hao
    NEUROCOMPUTING, 2020, 398 (398) : 291 - 292
  • [49] Arbitrary Scale Super-Resolution for Brain MRI Images
    Tan, Chuan
    Zhu, Jin
    Lio, Pietro
    ARTIFICIAL INTELLIGENCE APPLICATIONS AND INNOVATIONS, AIAI 2020, PT I, 2020, 583 : 165 - 176
  • [50] Hyperspectral Image Super-Resolution Meets Deep Learning: A Survey and Perspective
    Wang, Xinya
    Hu, Qian
    Cheng, Yingsong
    Ma, Jiayi
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2023, 10 (08) : 1668 - 1691