Blind image super-resolution based on prior correction network

被引:9
作者
Cao, Xiang [1 ]
Luo, Yihao [1 ]
Xiao, Yi [2 ]
Zhu, Xianyi [3 ]
Wang, Tianjiang [1 ]
Feng, Qi [1 ]
Tan, Zehan [4 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Comp Sci & Technol, Wuhan 430074, Hubei, Peoples R China
[2] Hunan Univ, Sch Design, Changsha 410082, Hunan, Peoples R China
[3] Xiangnan Univ, Coll Software & Commun Engn, Chenzhou 423000, Peoples R China
[4] Fudan Univ, Sch Comp Sci, Shanghai 200433, Peoples R China
关键词
Convolutional neural networks; Blind super-resolution; Blur kernel; Correction filter; ATTENTION NETWORK;
D O I
10.1016/j.neucom.2021.07.070
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Convolutional neural networks (CNNs) based super-resolution (SR) methods have achieved remarkable progress in recent years. Most of these methods assume that the degradation is known and fixed, such as bicubic downsampling. However, the performance of CNNs-based methods suffers from a severe drop when the actual degradation mismatch the training one. This paper proposes a prior correction network (PCNet) to solve the blind SR problem, which makes CNNs-based super-resolvers trained in a fixed blur kernel but applied to other unknown blur kernels. The PCNet consists of a kernel estimation network, a correction filter module, and a correction refinement network. The kernel estimation network aims to estimate unknown blur kernel from the input low-resolution (LR) image. The correction filter module then transfers the estimated degraded domains to adapt to specific degradations (e.g., bicubic downsampling). Finally, the correction refinement network adjusts the corrected LR image to eliminate the influence of blur kernel mismatch or misestimate. Experimental results on diverse datasets show that the proposed PCNet, combined with existing CNNs-based SR methods, outperforms other state-of-the-art algorithms for blind SR. Code is available at: \url{https://github.com/caoxiang104/PCNet}. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:525 / 534
页数:10
相关论文
共 48 条
[21]  
Huang JB, 2015, PROC CVPR IEEE, P5197, DOI 10.1109/CVPR.2015.7299156
[22]   Fast Blind Image Super Resolution Using Matrix-Variable Optimization [J].
Huang, Liqing ;
Xia, Youshen .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (03) :945-955
[23]   Accurate Image Super-Resolution Using Very Deep Convolutional Networks [J].
Kim, Jiwon ;
Lee, Jung Kwon ;
Lee, Kyoung Mu .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1646-1654
[24]  
King DB, 2015, ACS SYM SER, V1214, P1, DOI 10.1021/bk-2015-1214.ch001
[25]   Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution [J].
Lai, Wei-Sheng ;
Huang, Jia-Bin ;
Ahuja, Narendra ;
Yang, Ming-Hsuan .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5835-5843
[26]   Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network [J].
Ledig, Christian ;
Theis, Lucas ;
Huszar, Ferenc ;
Caballero, Jose ;
Cunningham, Andrew ;
Acosta, Alejandro ;
Aitken, Andrew ;
Tejani, Alykhan ;
Totz, Johannes ;
Wang, Zehan ;
Shi, Wenzhe .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :105-114
[27]   Enhanced Deep Residual Networks for Single Image Super-Resolution [J].
Lim, Bee ;
Son, Sanghyun ;
Kim, Heewon ;
Nah, Seungjun ;
Lee, Kyoung Mu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1132-1140
[28]   Fast and Robust Cascade Model for Multiple Degradation Single Image Super-Resolution [J].
Lopez-Tapia, Santiago ;
de la Blanca, Nicolas Perez .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :4747-4759
[29]  
Luo Z., 2020, ADV NEURAL INFORM PR
[30]   Sketch-based manga retrieval using manga109 dataset [J].
Matsui, Yusuke ;
Ito, Kota ;
Aramaki, Yuji ;
Fujimoto, Azuma ;
Ogawa, Toru ;
Yamasaki, Toshihiko ;
Aizawa, Kiyoharu .
MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (20) :21811-21838