Single-Image Super-Resolution via Linear Mapping of Interpolated Self-Examples

被引:93
|
作者
Bevilacqua, Marco [1 ]
Roumy, Aline [2 ]
Guillemot, Christine [2 ]
Morel, Marie-Line Alberi [3 ]
机构
[1] IMT Inst Adv Studies Lucca, I-55100 Lucca, Italy
[2] Inst Natl Rech Informat & Automat, F-35042 Rennes, France
[3] Alcatel Lucent, Bell Labs, Ctr Villarceaux, F-91620 Nozay, France
关键词
Super resolution; example-based; regression; neighbor embedding;
D O I
10.1109/TIP.2014.2364116
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a novel example-based single-image superresolution procedure that upscales to high-resolution (HR) a given low-resolution (LR) input image without relying on an external dictionary of image examples. The dictionary instead is built from the LR input image itself, by generating a double pyramid of recursively scaled, and subsequently interpolated, images, from which self-examples are extracted. The upscaling procedure is multipass, i.e., the output image is constructed by means of gradual increases, and consists in learning special linear mapping functions on this double pyramid, as many as the number of patches in the current image to upscale. More precisely, for each LR patch, similar self-examples are found, and, because of them, a linear function is learned to directly map it into its HR version. Iterative back projection is also employed to ensure consistency at each pass of the procedure. Extensive experiments and comparisons with other state-of-the-art methods, based both on external and internal dictionaries, show that our algorithm can produce visually pleasant upscalings, with sharp edges and well reconstructed details. Moreover, when considering objective metrics, such as Peak signal-to-noise ratio and Structural similarity, our method turns out to give the best performance.
引用
收藏
页码:5334 / 5347
页数:14
相关论文
共 50 条
  • [1] Single image super-resolution using self-examples and texture synthesis
    Chris Damkat
    Signal, Image and Video Processing , 2011, 5 : 343 - 352
  • [2] Single image super-resolution using self-examples and texture synthesis
    Damkat, Chris
    SIGNAL IMAGE AND VIDEO PROCESSING, 2011, 5 (03) : 343 - 352
  • [3] SINGLE IMAGE SUPER-RESOLUTION BASED ON SELF-EXAMPLES USING CONTEXT-DEPENDENT SUBPATCHES
    Choi, Jae-Seok
    Bae, Sung-Ho
    Kim, Munchurl
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 2835 - 2839
  • [4] Single-image super-resolution via local learning
    Tang, Yi
    Yan, Pingkun
    Yuan, Yuan
    Li, Xuelong
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2011, 2 (01) : 15 - 23
  • [5] Single-image super-resolution via local learning
    Yi Tang
    Pingkun Yan
    Yuan Yuan
    Xuelong Li
    International Journal of Machine Learning and Cybernetics, 2011, 2 : 15 - 23
  • [6] Selfie image super-resolution using an implicit prior learned from self-examples
    Hans, W. Jino
    Venkateswaran, N.
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (Suppl 4): : S9505 - S9513
  • [7] Selfie image super-resolution using an implicit prior learned from self-examples
    W. Jino Hans
    N. Venkateswaran
    Cluster Computing, 2019, 22 : 9505 - 9513
  • [8] BOOSTING PERFORMANCE AND SPEED OF SINGLE-IMAGE SUPER-RESOLUTION BASED ON PARTITIONED LINEAR REGRESSION
    Choudhury, Anustup
    van Beek, Peter
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 1419 - 1423
  • [9] FAST SINGLE-IMAGE SUPER-RESOLUTION WITH FILTER SELECTION
    Salvador, Jordi
    Perez-Pellitero, Eduardo
    Kochale, Axel
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 640 - 644
  • [10] Collaborative Representation Cascade for Single-Image Super-Resolution
    Zhang, Yongbing
    Zhang, Yulun
    Zhang, Jian
    Xu, Dong
    Fu, Yun
    Wang, Yisen
    Ji, Xiangyang
    Dai, Qionghai
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2019, 49 (05): : 845 - 860