Spatial-Frequency Fusion for Arbitrary-Scale Ultra-High-Definition Image Super-Resolution

被引:0
|
作者
Yang, Cuixin [1 ]
Xiao, Jun [1 ]
Lam, Kin-Man [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Elect & Elect Engn, Hong Kong, Peoples R China
关键词
Super-resolution; ultra-high-definition; frequency domain; arbitrary-scale;
D O I
10.1117/12.3018885
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Ultra-high-definition (UHD) image super-resolution (SR) has attracted increasing attention due to the popularity of modern devices, such as smartphones, which support the capture of UHD images, e.g. 4K and 8K images. However, existing UHD SR methods process the image in the spatial domain only. This limitation hinders their ability to effectively utilize the rich details and fine-grained textures in local areas of UHD images. To address this issue, our proposed method comprehensively exploits the global and local features of UHD images by combining spatial and frequency features. Additionally, previous UHD image SR methods can only handle a fixed scaling factor, but real-world applications very often require upscaling low-resolution images with different scales. Therefore, we employ an arbitrary-scale strategy in the SR training process, enabling super-resolution of UHD images at any scale with a single trained model. Experimental results demonstrate the effectiveness and superiority of our proposed method.
引用
收藏
页数:6
相关论文
共 50 条
  • [1] Benchmarking Ultra-High-Definition Image Super-resolution
    Zhang, Kaihao
    Li, Dongxu
    Luo, Wenhan
    Ren, Wenqi
    Stenger, Bjorn
    Liu, Wei
    Li, Hongdong
    Yang, Ming-Hsuan
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 14749 - 14758
  • [2] Arbitrary-Scale Hyperspectral Image Super-Resolution From a Fusion Perspective With Spatial Priors
    Chen, Guochao
    Nie, Jiangtao
    Wei, Wei
    Zhang, Lei
    Zhang, Yanning
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [3] Arbitrary-Scale Image Super-Resolution via Degradation Perception
    Wan, Wenbo
    Wang, Zezhu
    Wang, Zhiyan
    Gu, Lingchen
    Sun, Jiande
    Wang, Qiang
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2024, 10 : 666 - 676
  • [4] Activating More Information in Arbitrary-Scale Image Super-Resolution
    Zhao, Yaoqian
    Teng, Qizhi
    Chen, Honggang
    Zhang, Shujiang
    He, Xiaohai
    Li, Yi
    Sheriff, Ray E.
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 7946 - 7961
  • [5] An Image Arbitrary-Scale Super-Resolution Network Using Frequency-domain Information
    Fang, Jing
    Yu, Yinbo
    Wang, Zhongyuan
    Ding, Xin
    Hu, Ruimin
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (03)
  • [6] Local Implicit Normalizing Flow for Arbitrary-Scale Image Super-Resolution
    Yao, Jie-En
    Tsao, Li-Yuan
    Lo, Yi-Chen
    Tseng, Roy
    Chang, Chia-Che
    Lee, Chun-Yi
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1776 - 1785
  • [7] ADAPTIVE LOCAL IMPLICIT IMAGE FUNCTION FOR ARBITRARY-SCALE SUPER-RESOLUTION
    Li, Hongwei
    Dai, Tao
    Li, Yiming
    Zou, Xueyi
    Xia, Shu-Tao
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 4033 - 4037
  • [8] UNCERTAINTY AWARE IMPLICIT IMAGE FUNCTION FOR ARBITRARY-SCALE SUPER-RESOLUTION
    Jena, Swastik
    Panda, Saptarshi
    Balabantaray, Bunil Kumar
    Nayak, Rajashree
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 2440 - 2444
  • [9] Enhanced dual branches network for arbitrary-scale image super-resolution
    Li, Guangping
    Xiao, Huanling
    Liang, Dingkai
    ELECTRONICS LETTERS, 2023, 59 (01)
  • [10] Deep Arbitrary-Scale Image Super-Resolution via Scale-Equivariance Pursuit
    Wang, Xiaohang
    Chen, Xuanhong
    Ni, Bingbing
    Wang, Hang
    Tong, Zhengyan
    Liu, Yutian
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1786 - 1795