Arbitrary-scale Super-resolution via Deep Learning: A Comprehensive Survey

被引:5
|
作者
Liu, Hongying [1 ]
Li, Zekun [2 ]
Shang, Fanhua [3 ]
Liu, Yuanyuan [2 ]
Wan, Liang [1 ,3 ]
Feng, Wei [3 ]
Timofte, Radu [4 ,5 ]
机构
[1] Tianjin Univ, Med Coll, Tianjin 300072, Peoples R China
[2] Xidian Univ, Sch Artificial Intelligence, Key Lab Intelligent Percept & Image Understanding, Minist Educ, Xian 710071, Peoples R China
[3] Tianjin Univ, Coll Intelligence & Comp, Tianjin 300350, Peoples R China
[4] Swiss Fed Inst Technol, Zurich, Switzerland
[5] Univ Wurzburg, CAIDAS & IFI, Comp Vis Lab, Wurzburg, Germany
关键词
Image super-resolution; Video super-resolution; Arbitrary scale; Deep learning; SINGLE IMAGE SUPERRESOLUTION; NETWORK; VIDEO;
D O I
10.1016/j.inffus.2023.102015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Super -resolution (SR) is an essential class of low-level vision tasks, which aims to improve the resolution of images or videos in computer vision. In recent years, significant progress has been made in image and video super -resolution techniques based on deep learning. Nevertheless, most of the methods only consider SR with a few integer scale factors, which limits the application of the SR techniques to real -world problems. Recently, the methods to achieve arbitrary -scale super -resolution via a single model have attracted much attention. However, there is no work to thoroughly analyze the arbitrary -scale methods based on deep learning. In this work, we present a comprehensive and systematic review of 45 existing deep learning -based methods for arbitrary -scale image and video SR. We first classify the existing SR methods according to the resolved scale factors. Furthermore, we propose an in-depth taxonomy for state-of-the-art methods based on the core problem of how to achieve arbitrary -scale super -resolution, i.e., how to perform arbitrary -scale upsampling. Moreover, the performance of existing arbitrary -scale SR methods is compared, and their advantages and limitations are analyzed. We also provide some guidance for the selection of these methods in different real -world applications. Finally, we briefly discuss the future directions of arbitrary -scale super -resolution, which shows some inspirations for the progress of subsequent works on arbitrary -scale image and video super -resolution tasks. The repository of this work is available at https://github.com/Weepingchestnut/Arbitrary-Scale-SR.
引用
收藏
页数:26
相关论文
共 50 条
  • [1] Deep Arbitrary-Scale Image Super-Resolution via Scale-Equivariance Pursuit
    Wang, Xiaohang
    Chen, Xuanhong
    Ni, Bingbing
    Wang, Hang
    Tong, Zhengyan
    Liu, Yutian
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1786 - 1795
  • [2] Arbitrary-Scale Image Super-Resolution via Degradation Perception
    Wan, Wenbo
    Wang, Zezhu
    Wang, Zhiyan
    Gu, Lingchen
    Sun, Jiande
    Wang, Qiang
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2024, 10 : 666 - 676
  • [3] Arbitrary-Scale Video Super-Resolution with Structural and Textural Priors
    Shang, Wei
    Ren, Dongwei
    Zhang, Wanying
    Fang, Yuming
    Zuo, Wangmeng
    Ma, Kede
    COMPUTER VISION-ECCV 2024, PT LVII, 2025, 15115 : 73 - 90
  • [4] Cascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolution
    Chen, Hao-Wei
    Xu, Yu-Syuan
    Hong, Min-Fong
    Tsai, Yi-Min
    Kuo, Hsien-Kai
    Lee, Chun-Yi
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 18257 - 18267
  • [5] Activating More Information in Arbitrary-Scale Image Super-Resolution
    Zhao, Yaoqian
    Teng, Qizhi
    Chen, Honggang
    Zhang, Shujiang
    He, Xiaohai
    Li, Yi
    Sheriff, Ray E.
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 7946 - 7961
  • [6] SAVSR: Arbitrary-Scale Video Super-Resolution via a Learned Scale-Adaptive Network
    Li, Zekun
    Liu, Hongying
    Shang, Fanhua
    Liu, Yuanyuan
    Wan, Liang
    Feng, Wei
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 4, 2024, : 3288 - 3296
  • [7] Deep Fourier-based Arbitrary-scale Super-resolution for Real-time Rendering
    Zhang, Haonan
    Guo, Jie
    Zhang, Jiawei
    Qin, Haoyu
    Feng, Zesen
    Yang, Ming
    Guo, Yanwen
    PROCEEDINGS OF SIGGRAPH 2024 CONFERENCE PAPERS, 2024,
  • [8] Deep Arbitrary-Scale Unfolding Network for Color-Guided Depth Map Super-Resolution
    Zhang, Jialong
    Zhao, Lijun
    Zhang, Jinjing
    Chen, Bintao
    Wang, Anhong
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT X, 2024, 14434 : 225 - 236
  • [9] Local Implicit Normalizing Flow for Arbitrary-Scale Image Super-Resolution
    Yao, Jie-En
    Tsao, Li-Yuan
    Lo, Yi-Chen
    Tseng, Roy
    Chang, Chia-Che
    Lee, Chun-Yi
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1776 - 1785
  • [10] ADAPTIVE LOCAL IMPLICIT IMAGE FUNCTION FOR ARBITRARY-SCALE SUPER-RESOLUTION
    Li, Hongwei
    Dai, Tao
    Li, Yiming
    Zou, Xueyi
    Xia, Shu-Tao
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 4033 - 4037