Learning Distinguishable Degradation Maps for Unknown Image Super-Resolution

被引:0
作者
Liu, Zhenbing [1 ]
Huang, Jieyu [1 ]
Wang, Wenhao [1 ]
Lu, Haoxiang [1 ]
Lan, Rushi [1 ]
机构
[1] Guilin Univ Elect Technol, Sch Comp & Informat Secur, Guilin 541004, Peoples R China
基金
中国国家自然科学基金;
关键词
Degradation; Kernel; Image reconstruction; Estimation; Superresolution; Adaptation models; Contrastive learning; Iterative methods; Feature extraction; Analytical models; Unknown image super-resolution; contrastive learning; convolutional neural networks; degradation maps; CONVOLUTIONAL NETWORK;
D O I
10.1109/TMM.2024.3521839
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Most existing super-resolution (SR) methods assume that the degradation is fixed (e.g., bicubic downsampling), whereas their performance would be degraded if the actual degradation differs from this assumption. To deal with unknown degradations, existing unknown SR methods are committed to learning degradation representation to generate high-resolution images. Nevertheless, they ignore that the impact of degradations on images is related to image content, or they learn degradation representations without any constraints. In this article, we propose a degradation maps extractor for unknown SR. Specifically, we learn degradation maps and condense them into a one-dimensional representation space to distinguish various degradations, which obtains distinguishable degradation maps and preserves the connection with the image contents. Furthermore, we propose a degradation map-guided SR (DMGSR) network, in which the degradation maps adaptively influence the SR process by applying channel attention and spatial attention to middle features. With the cooperation of the degradation maps extractor and the degradation maps-guided SR network, our network can flexibly handle various degradations. Experimental results show that our model achieves state-of-the-art performance in quantitative and qualitative metrics for the unknown SR task.
引用
收藏
页码:2530 / 2542
页数:13
相关论文
共 61 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]   A Deep Journey into Super-resolution: A Survey [J].
Anwar, Saeed ;
Khan, Salman ;
Barnes, Nick .
ACM COMPUTING SURVEYS, 2020, 53 (03)
[3]   Multicolor super-resolution imaging with photo-switchable fluorescent probes [J].
Bates, Mark ;
Huang, Bo ;
Dempsey, Graham T. ;
Zhuang, Xiaowei .
SCIENCE, 2007, 317 (5845) :1749-1753
[4]  
Bell-Kligler S, 2019, ADV NEUR IN, V32
[5]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[6]   To Learn Image Super-Resolution, Use a GAN to Learn How to Do Image Degradation First [J].
Bulat, Adrian ;
Yang, Jing ;
Tzimiropoulos, Georgios .
COMPUTER VISION - ECCV 2018, PT VI, 2018, 11210 :187-202
[7]  
Chen H., 2020, P IEEE CVF C COMP VI, P12294
[8]   Real-world single image super-resolution: A brief review [J].
Chen, Honggang ;
He, Xiaohai ;
Qing, Linbo ;
Wu, Yuanyuan ;
Ren, Chao ;
Sheriff, Ray E. ;
Zhu, Ce .
INFORMATION FUSION, 2022, 79 :124-145
[9]  
Chen T., 2020, PMLR, P1597
[10]   Activating More Pixels in Image Super-Resolution Transformer [J].
Chen, Xiangyu ;
Wang, Xintao ;
Zhou, Jiantao ;
Qiao, Yu ;
Dong, Chao .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, :22367-22377