Arbitrary-Scale Image Super-Resolution via Degradation Perception

被引:0
作者
Wan, Wenbo [1 ]
Wang, Zezhu [1 ]
Wang, Zhiyan [1 ]
Gu, Lingchen [1 ]
Sun, Jiande [1 ]
Wang, Qiang [2 ,3 ]
机构
[1] Shandong Normal Univ, Sch Informat Sci & Engn, Jinan 250358, Peoples R China
[2] Shenyang Univ, Key Lab Mfg Ind Integrated, Shenyang 110044, Peoples R China
[3] Chinese Acad Sci, Shenyang Inst Automat, State Key Lab Robot, Shenyang 110016, Peoples R China
关键词
Superresolution; Degradation; Image reconstruction; Convolution; Image coding; Kernel; Feature extraction; Image refinement network; super-resolution; arbitrary scale; super-resolution encoding guidance module; NETWORK;
D O I
10.1109/TCI.2024.3393712
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In recent years, with the rapid development of deep learning, super-resolution research oriented towards arbitrary scale (e.g., arbitrary integer and non-integer scale factors) factors has achieved great success. However, in terms of pixel space, the degradation in the same image at arbitrary scale factors is spatially variable. Similarly, the degradation is variable for different scale factors. In this paper, we propose a method that can adaptively deal with varying degradation at different scale factors, which consists of two parts. The first part, Image Refinement Network (IRN), adopts a dynamic convolution method to deal with different degradations under arbitrary scale factors on a pixel-by-pixel basis. It solves the spatial invariance problem of the ordinary convolution kernel. For well calculating the pixel mapping relationships that change during the super-resolution of arbitary scale factors, we propose a second Module, Super-Resolution Encoding Guidance Module (SREGM). It takes the high-resolution pixel space as a reference frame and uses the modelling results as prior information to better guide the high-resolution reconstruction. Extensive experiments have shown that our method achieves good results in the super-resolution of a single image with an arbitrary scale factor.
引用
收藏
页码:666 / 676
页数:11
相关论文
共 50 条
  • [21] Deep Fourier-based Arbitrary-scale Super-resolution for Real-time Rendering
    Zhang, Haonan
    Guo, Jie
    Zhang, Jiawei
    Qin, Haoyu
    Feng, Zesen
    Yang, Ming
    Guo, Yanwen
    PROCEEDINGS OF SIGGRAPH 2024 CONFERENCE PAPERS, 2024,
  • [22] Frequency Generation for Real-World Image Super-Resolution
    Guan, Wenxue
    Li, Haobo
    Xu, Dawei
    Liu, Jiaxin
    Gong, Shenghua
    Liu, Jun
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (08) : 7029 - 7040
  • [23] Deep Stereoscopic Image Super-Resolution via Interaction Module
    Lei, Jianjun
    Zhang, Zhe
    Fan, Xiaoting
    Yang, Bolan
    Li, Xinxin
    Chen, Ying
    Huang, Qingming
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (08) : 3051 - 3061
  • [24] Real-World Light Field Image Super-Resolution Via Degradation Modulation
    Wang, Yingqian
    Liang, Zhengyu
    Wang, Longguang
    Yang, Jungang
    An, Wei
    Guo, Yulan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, : 1 - 15
  • [25] Binary Lightweight Neural Networks for Arbitrary Scale Super-Resolution of Remote Sensing Images
    Wang, Yufeng
    Zhang, Huayu
    Zeng, Xianlin
    Wang, Bowen
    Li, Wei
    Ding, Wenrui
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [26] Multi-Scale Image Super-Resolution Via a Single Extendable Deep Network
    Zhang, Huanrong
    Xiao, Jie
    Jin, Zhi
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2021, 15 (02) : 253 - 263
  • [27] Light Field Image Super-Resolution via Mutual Attention Guidance
    Wang, Zijian
    Lu, Yao
    IEEE ACCESS, 2021, 9 : 129022 - 129031
  • [28] Steformer: Efficient Stereo Image Super-Resolution With Transformer
    Lin, Jianxin
    Yin, Lianying
    Wang, Yijun
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 8396 - 8407
  • [29] Global Learnable Attention for Single Image Super-Resolution
    Su, Jian-Nan
    Gan, Min
    Chen, Guang-Yong
    Yin, Jia-Li
    Chen, C. L. Philip
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (07) : 8453 - 8465
  • [30] Fast and Robust Cascade Model for Multiple Degradation Single Image Super-Resolution
    Lopez-Tapia, Santiago
    de la Blanca, Nicolas Perez
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 4747 - 4759