Spatial-Frequency Fusion for Arbitrary-Scale Ultra-High-Definition Image Super-Resolution

被引:0
|
作者
Yang, Cuixin [1 ]
Xiao, Jun [1 ]
Lam, Kin-Man [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Elect & Elect Engn, Hong Kong, Peoples R China
关键词
Super-resolution; ultra-high-definition; frequency domain; arbitrary-scale;
D O I
10.1117/12.3018885
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Ultra-high-definition (UHD) image super-resolution (SR) has attracted increasing attention due to the popularity of modern devices, such as smartphones, which support the capture of UHD images, e.g. 4K and 8K images. However, existing UHD SR methods process the image in the spatial domain only. This limitation hinders their ability to effectively utilize the rich details and fine-grained textures in local areas of UHD images. To address this issue, our proposed method comprehensively exploits the global and local features of UHD images by combining spatial and frequency features. Additionally, previous UHD image SR methods can only handle a fixed scaling factor, but real-world applications very often require upscaling low-resolution images with different scales. Therefore, we employ an arbitrary-scale strategy in the SR training process, enabling super-resolution of UHD images at any scale with a single trained model. Experimental results demonstrate the effectiveness and superiority of our proposed method.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] ASDN: A Deep Convolutional Network for Arbitrary Scale Image Super-Resolution
    Jialiang Shen
    Yucheng Wang
    Jian Zhang
    Mobile Networks and Applications, 2021, 26 : 13 - 26
  • [42] Cross Transformer Network for Scale-Arbitrary Image Super-Resolution
    He, Dehong
    Wu, Song
    Liu, Jinpeng
    Xiao, Guoqiang
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT II, 2022, 13369 : 633 - 644
  • [43] OPE-SR: Orthogonal Position Encoding for Designing a Parameter-free Upsampling Module in Arbitrary-scale Image Super-Resolution
    Song, Gaochao
    Sun, Qian
    Zhang, Luo
    Su, Ran
    Shi, Jianfeng
    He, Ying
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 10009 - 10020
  • [44] Single Image Super-Resolution with Arbitrary Magnification Based on High-Frequency Attention Network
    Yun, Jun-Seok
    Yoo, Seok-Bong
    MATHEMATICS, 2022, 10 (02)
  • [45] An ultra-high-definition multi-exposure image fusion method based on multi-scale feature extraction
    Jia, Xiuyi
    Lin, Qiaowanni
    Ding, Weiping
    APPLIED SOFT COMPUTING, 2024, 166
  • [46] Memory-Efficient Discrete Cosine Transform Domain Weight Modulation Transformer for Arbitrary-Scale Super-Resolution
    Kim, Min Hyuk
    Yoo, Seok Bong
    MATHEMATICS, 2023, 11 (18)
  • [47] Hyperspectral Image Super-Resolution Based on Spatial and Spectral Correlation Fusion
    Yi, Chen
    Zhao, Yong-Qiang
    Chan, Jonathan Cheung-Wai
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (07): : 4165 - 4177
  • [48] COMPASS: High-Efficiency Deep Image Compression with Arbitrary-scale Spatial Scalability
    Park, Jongmin
    Lee, Jooyoung
    Kim, Munchurl
    arXiv, 2023,
  • [49] Frequency-Spatial Domain Feature Fusion for Spectral Super-Resolution
    Tan, Lishan
    Dian, Renwei
    Li, Shutao
    Liu, Jinyang
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2024, 10 (589-599) : 589 - 599
  • [50] COMPASS: High-Efficiency Deep Image Compression with Arbitrary-scale Spatial Scalability
    Park, Jongmin
    Lee, Jooyoung
    Kim, Munchurl
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 12780 - 12789