Fast Image Super-resolution Based on In-place Example Regression

被引:238
作者
Yang, Jianchao [1 ]
Lin, Zhe [1 ]
Cohen, Scott [1 ]
机构
[1] Adobe Res, San Jose, CA 95110 USA
来源
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) | 2013年
关键词
D O I
10.1109/CVPR.2013.141
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a fast regression model for practical single image super-resolution based on in-place examples, by leveraging two fundamental super-resolution approaches-learning from an external database and learning from self-examples. Our in-place self-similarity refines the recently proposed local self-similarity by proving that a patch in the upper scale image have good matches around its origin location in the lower scale image. Based on the in-place examples, a first-order approximation of the nonlinear mapping function from low- to high-resolution image patches is learned. Extensive experiments on benchmark and real-world images demonstrate that our algorithm can produce natural-looking results with sharp edges and preserved fine details, while the current state-of-the-art algorithms are prone to visual artifacts. Furthermore, our model can easily extend to deal with noise by combining the regression results on multiple in-place examples for robust estimation. The algorithm runs fast and is particularly useful for practical applications, where the input images typically contain diverse textures and they are potentially contaminated by noise or compression artifacts.
引用
收藏
页码:1059 / 1066
页数:8
相关论文
共 21 条
  • [1] A non-local algorithm for image denoising
    Buades, A
    Coll, B
    Morel, JM
    [J]. 2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, : 60 - 65
  • [2] Super-resolution through neighbor embedding
    Chang, H
    Yeung, DY
    Xiong, Y
    [J]. PROCEEDINGS OF THE 2004 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, 2004, : 275 - 282
  • [3] Dai S., 2007, Computer Vision and Pattern Recognition, P1, DOI DOI 10.1109/CVPR.2007.383028
  • [4] Ebrahimi M, 2007, LECT NOTES COMPUT SC, V4633, P117
  • [5] Multiscale shape and detail enhancement from multi-light image collections
    Fattal, Raanan
    Agrawala, Maneesh
    Rusinkiewicz, Szymon
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2007, 26 (03):
  • [6] Image and Video Upscaling from Local Self-Examples
    Freedman, Gilad
    Fattal, Raanan
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2011, 30 (02):
  • [7] Example-based super-resolution
    Freeman, WT
    Jones, TR
    Pasztor, EC
    [J]. IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2002, 22 (02) : 56 - 65
  • [8] Freund Yoav, 2007, ADV NEURAL INFORM PR, P473
  • [9] Glasner D, 2009, IEEE I CONF COMP VIS, P349, DOI 10.1109/ICCV.2009.5459271
  • [10] He H, 2011, PROC CVPR IEEE, P449, DOI 10.1109/CVPR.2011.5995713