Arbitrary-Scale Image Super-Resolution via Degradation Perception

被引:0
|
作者
Wan, Wenbo [1 ]
Wang, Zezhu [1 ]
Wang, Zhiyan [1 ]
Gu, Lingchen [1 ]
Sun, Jiande [1 ]
Wang, Qiang [2 ,3 ]
机构
[1] Shandong Normal Univ, Sch Informat Sci & Engn, Jinan 250358, Peoples R China
[2] Shenyang Univ, Key Lab Mfg Ind Integrated, Shenyang 110044, Peoples R China
[3] Chinese Acad Sci, Shenyang Inst Automat, State Key Lab Robot, Shenyang 110016, Peoples R China
关键词
Superresolution; Degradation; Image reconstruction; Convolution; Image coding; Kernel; Feature extraction; Image refinement network; super-resolution; arbitrary scale; super-resolution encoding guidance module; NETWORK;
D O I
10.1109/TCI.2024.3393712
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In recent years, with the rapid development of deep learning, super-resolution research oriented towards arbitrary scale (e.g., arbitrary integer and non-integer scale factors) factors has achieved great success. However, in terms of pixel space, the degradation in the same image at arbitrary scale factors is spatially variable. Similarly, the degradation is variable for different scale factors. In this paper, we propose a method that can adaptively deal with varying degradation at different scale factors, which consists of two parts. The first part, Image Refinement Network (IRN), adopts a dynamic convolution method to deal with different degradations under arbitrary scale factors on a pixel-by-pixel basis. It solves the spatial invariance problem of the ordinary convolution kernel. For well calculating the pixel mapping relationships that change during the super-resolution of arbitary scale factors, we propose a second Module, Super-Resolution Encoding Guidance Module (SREGM). It takes the high-resolution pixel space as a reference frame and uses the modelling results as prior information to better guide the high-resolution reconstruction. Extensive experiments have shown that our method achieves good results in the super-resolution of a single image with an arbitrary scale factor.
引用
收藏
页码:666 / 676
页数:11
相关论文
共 50 条
  • [1] Deep Arbitrary-Scale Image Super-Resolution via Scale-Equivariance Pursuit
    Wang, Xiaohang
    Chen, Xuanhong
    Ni, Bingbing
    Wang, Hang
    Tong, Zhengyan
    Liu, Yutian
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1786 - 1795
  • [2] Activating More Information in Arbitrary-Scale Image Super-Resolution
    Zhao, Yaoqian
    Teng, Qizhi
    Chen, Honggang
    Zhang, Shujiang
    He, Xiaohai
    Li, Yi
    Sheriff, Ray E.
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 7946 - 7961
  • [3] Local Implicit Normalizing Flow for Arbitrary-Scale Image Super-Resolution
    Yao, Jie-En
    Tsao, Li-Yuan
    Lo, Yi-Chen
    Tseng, Roy
    Chang, Chia-Che
    Lee, Chun-Yi
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1776 - 1785
  • [4] ADAPTIVE LOCAL IMPLICIT IMAGE FUNCTION FOR ARBITRARY-SCALE SUPER-RESOLUTION
    Li, Hongwei
    Dai, Tao
    Li, Yiming
    Zou, Xueyi
    Xia, Shu-Tao
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 4033 - 4037
  • [5] Enhanced dual branches network for arbitrary-scale image super-resolution
    Li, Guangping
    Xiao, Huanling
    Liang, Dingkai
    ELECTRONICS LETTERS, 2023, 59 (01)
  • [6] UNCERTAINTY AWARE IMPLICIT IMAGE FUNCTION FOR ARBITRARY-SCALE SUPER-RESOLUTION
    Jena, Swastik
    Panda, Saptarshi
    Balabantaray, Bunil Kumar
    Nayak, Rajashree
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 2440 - 2444
  • [7] Arbitrary-scale Super-resolution via Deep Learning: A Comprehensive Survey
    Liu, Hongying
    Li, Zekun
    Shang, Fanhua
    Liu, Yuanyuan
    Wan, Liang
    Feng, Wei
    Timofte, Radu
    INFORMATION FUSION, 2024, 102
  • [8] Arbitrary-Scale Video Super-Resolution with Structural and Textural Priors
    Shang, Wei
    Ren, Dongwei
    Zhang, Wanying
    Fang, Yuming
    Zuo, Wangmeng
    Ma, Kede
    COMPUTER VISION-ECCV 2024, PT LVII, 2025, 15115 : 73 - 90
  • [9] Cascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolution
    Chen, Hao-Wei
    Xu, Yu-Syuan
    Hong, Min-Fong
    Tsai, Yi-Min
    Kuo, Hsien-Kai
    Lee, Chun-Yi
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 18257 - 18267
  • [10] Enhanced implicit function-based network for arbitrary-scale image super-resolution
    Wen, Caizhen
    Yang, Zhijing
    Shi, Yukai
    Qing, Chunmei
    Cheng, Yongqiang
    JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (04)