Learning Distinguishable Degradation Maps for Unknown Image Super-Resolution

被引:0
作者
Liu, Zhenbing [1 ]
Huang, Jieyu [1 ]
Wang, Wenhao [1 ]
Lu, Haoxiang [1 ]
Lan, Rushi [1 ]
机构
[1] Guilin Univ Elect Technol, Sch Comp & Informat Secur, Guilin 541004, Peoples R China
基金
中国国家自然科学基金;
关键词
Degradation; Kernel; Image reconstruction; Estimation; Superresolution; Adaptation models; Contrastive learning; Iterative methods; Feature extraction; Analytical models; Unknown image super-resolution; contrastive learning; convolutional neural networks; degradation maps; CONVOLUTIONAL NETWORK;
D O I
10.1109/TMM.2024.3521839
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Most existing super-resolution (SR) methods assume that the degradation is fixed (e.g., bicubic downsampling), whereas their performance would be degraded if the actual degradation differs from this assumption. To deal with unknown degradations, existing unknown SR methods are committed to learning degradation representation to generate high-resolution images. Nevertheless, they ignore that the impact of degradations on images is related to image content, or they learn degradation representations without any constraints. In this article, we propose a degradation maps extractor for unknown SR. Specifically, we learn degradation maps and condense them into a one-dimensional representation space to distinguish various degradations, which obtains distinguishable degradation maps and preserves the connection with the image contents. Furthermore, we propose a degradation map-guided SR (DMGSR) network, in which the degradation maps adaptively influence the SR process by applying channel attention and spatial attention to middle features. With the cooperation of the degradation maps extractor and the degradation maps-guided SR network, our network can flexibly handle various degradations. Experimental results show that our model achieves state-of-the-art performance in quantitative and qualitative metrics for the unknown SR task.
引用
收藏
页码:2530 / 2542
页数:13
相关论文
共 61 条
[51]   Unified Dynamic Convolutional Network for Super-Resolution with Variational Degradations [J].
Xu, Yu-Syuan ;
Tseng, Shou-Yao Roy ;
Tseng, Yu ;
Kuo, Hsien-Kai ;
Tsai, Yi-Min .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :12493-12502
[52]   Deep Learning for Single Image Super-Resolution: A Brief Review [J].
Yang, Wenming ;
Zhang, Xuechen ;
Tian, Yapeng ;
Wang, Wei ;
Xue, Jing-Hao ;
Liao, Qingmin .
IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (12) :3106-3121
[53]   Unsupervised simple Siamese representation learning for blind super-resolution [J].
Yin, Pengfei ;
Liu, Zhonghua ;
Wu, Di ;
Huo, Hua ;
Wang, Haijun ;
Zhang, Kaibing .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 114
[54]  
Zeyde R., 2012, CURVES SURFACES, DOI [10.1007/978-3-642-27413-8_47, DOI 10.1007/978-3-642-27413-8_47, DOI 10.1007/978-3-642-27413-847]
[55]   Designing a Practical Degradation Model for Deep Blind Image Super-Resolution [J].
Zhang, Kai ;
Liang, Jingyun ;
Van Gool, Luc ;
Timofte, Radu .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :4771-4780
[56]   Deep Unfolding Network for Image Super-Resolution [J].
Zhang, Kai ;
Van Gool, Luc ;
Timofte, Radu .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :3214-3223
[57]   Learning a Single Convolutional Super-Resolution Network for Multiple Degradations [J].
Zhang, Kai ;
Zuo, Wangmeng ;
Zhang, Lei .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3262-3271
[58]   Frequency aggregation network for blind super-resolution based on degradation representation [J].
Zhang, Yan ;
Liu, Ziyang ;
Liu, Shudong ;
Sun, Yemei .
DIGITAL SIGNAL PROCESSING, 2023, 133
[59]   Weakly-supervised contrastive learning-based implicit degradation modeling for blind image super-resolution [J].
Zhang, Yongfei ;
Dong, Ling ;
Yang, Hong ;
Qing, Linbo ;
He, Xiaohai ;
Chen, Honggang .
KNOWLEDGE-BASED SYSTEMS, 2022, 249
[60]   Image Super-Resolution Using Very Deep Residual Channel Attention Networks [J].
Zhang, Yulun ;
Li, Kunpeng ;
Li, Kai ;
Wang, Lichen ;
Zhong, Bineng ;
Fu, Yun .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :294-310