Single-Image Super-Resolution via Linear Mapping of Interpolated Self-Examples

被引:95
作者
Bevilacqua, Marco [1 ]
Roumy, Aline [2 ]
Guillemot, Christine [2 ]
Morel, Marie-Line Alberi [3 ]
机构
[1] IMT Inst Adv Studies Lucca, I-55100 Lucca, Italy
[2] Inst Natl Rech Informat & Automat, F-35042 Rennes, France
[3] Alcatel Lucent, Bell Labs, Ctr Villarceaux, F-91620 Nozay, France
关键词
Super resolution; example-based; regression; neighbor embedding;
D O I
10.1109/TIP.2014.2364116
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a novel example-based single-image superresolution procedure that upscales to high-resolution (HR) a given low-resolution (LR) input image without relying on an external dictionary of image examples. The dictionary instead is built from the LR input image itself, by generating a double pyramid of recursively scaled, and subsequently interpolated, images, from which self-examples are extracted. The upscaling procedure is multipass, i.e., the output image is constructed by means of gradual increases, and consists in learning special linear mapping functions on this double pyramid, as many as the number of patches in the current image to upscale. More precisely, for each LR patch, similar self-examples are found, and, because of them, a linear function is learned to directly map it into its HR version. Iterative back projection is also employed to ensure consistency at each pass of the procedure. Extensive experiments and comparisons with other state-of-the-art methods, based both on external and internal dictionaries, show that our algorithm can produce visually pleasant upscalings, with sharp edges and well reconstructed details. Moreover, when considering objective metrics, such as Peak signal-to-noise ratio and Structural similarity, our method turns out to give the best performance.
引用
收藏
页码:5334 / 5347
页数:14
相关论文
共 33 条
[1]  
[Anonymous], 2001, 125 HELS U TECHN CON
[2]   Limits on super-resolution and how to break them [J].
Baker, S ;
Kanade, T .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (09) :1167-1183
[3]  
Bevilacqua M, 2013, 18 INT C DIG SIGN PR, P1
[4]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[5]   A non-local algorithm for image denoising [J].
Buades, A ;
Coll, B ;
Morel, JM .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, :60-65
[6]   Neighbor embedding based super-resolution algorithm through edge detection and feature selection [J].
Chan, Tak-Ming ;
Zhang, Junping ;
Pu, Jian ;
Huang, Hua .
PATTERN RECOGNITION LETTERS, 2009, 30 (05) :494-502
[7]   Super-resolution through neighbor embedding [J].
Chang, H ;
Yeung, DY ;
Xiong, Y .
PROCEEDINGS OF THE 2004 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, 2004, :275-282
[8]  
Fan W., 2007, Proc. of the CVPR, P1, DOI DOI 10.1109/CVPR.2007.383001
[9]  
Fattal R, 2007, ACM T GRAPHIC, V26, DOI [10.1145/1276377.1276496, 10.1145/1239451.1239546]
[10]   Image and Video Upscaling from Local Self-Examples [J].
Freedman, Gilad ;
Fattal, Raanan .
ACM TRANSACTIONS ON GRAPHICS, 2011, 30 (02)