Fast and Robust Cascade Model for Multiple Degradation Single Image Super-Resolution

被引:9
作者
Lopez-Tapia, Santiago [1 ]
de la Blanca, Nicolas Perez [1 ]
机构
[1] Univ Granada, Dept Ciencias Computac & Inteligencia Artificial, Granada 18014, Spain
基金
欧盟地平线“2020”;
关键词
Degradation; Kernel; Computational modeling; Feature extraction; Task analysis; Superresolution; Adaptation models; Single image super-resolution; super-resolution; multiple degradation deconvolution; convolutional neural networks; cascade model;
D O I
10.1109/TIP.2021.3074821
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Single Image Super-Resolution (SISR) is one of the low-level computer vision problems that has received increased attention in the last few years. Current approaches are primarily based on harnessing the power of deep learning models and optimization techniques to reverse the degradation model. Owing to its hardness, isotropic blurring or Gaussians with small anisotropic deformations have been mainly considered. Here, we widen this scenario by including large non-Gaussian blurs that arise in real camera movements. Our approach leverages the degradation model and proposes a new formulation of the Convolutional Neural Network (CNN) cascade model, where each network sub-module is constrained to solve a specific degradation: deblurring or upsampling. A new densely connected CNN-architecture is proposed where the output of each sub-module is restricted using some external knowledge to focus it on its specific task. As far we know, this use of domain-knowledge to module-level is a novelty in SISR. To fit the finest model, a final sub-module takes care of the residual errors propagated by the previous sub-modules. We check our model with three state-of-the-art (SOTA) datasets in SISR and compare the results with the SOTA models. The results show that our model is the only one able to manage our wider set of deformations. Furthermore, our model overcomes all current SOTA methods for a standard set of deformations. In terms of computational load, our model also improves on the two closest competitors in terms of efficiency. Although the approach is non-blind and requires an estimation of the blur kernel, it shows robustness to blur kernel estimation errors, making it a good alternative to blind models.
引用
收藏
页码:4747 / 4759
页数:13
相关论文
共 58 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]  
Albert A., 1972, REGRESSION MOORE PEN
[3]  
[Anonymous], 2016, 4 INT C LEARN REPR I
[4]  
[Anonymous], 2016, Advances in Neural Information Processing Systems
[5]   A Deep Journey into Super-resolution: A Survey [J].
Anwar, Saeed ;
Khan, Salman ;
Barnes, Nick .
ACM COMPUTING SURVEYS, 2020, 53 (03)
[6]   Variational Bayesian Super Resolution [J].
Babacan, S. Derin ;
Molina, Rafael ;
Katsaggelos, Aggelos K. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (04) :984-999
[7]   Maximum a Posteriori Video Super-Resolution Using a New Multichannel Image Prior [J].
Belekos, Stefanos P. ;
Galatsanos, Nikolaos P. ;
Katsaggelos, Aggelos K. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2010, 19 (06) :1451-1464
[8]  
Bigdeli SA, 2017, ADV NEUR IN, V30
[9]   Modeling the Performance of Image Restoration from Motion Blur [J].
Boracchi, Giacomo ;
Foi, Alessandro .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (08) :3502-3517
[10]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122