Super-resolution reconstruction of faces by enhanced global models of shape and texture

被引:19
作者
Akyol, Aydin [1 ]
Gokmen, Muhittin [1 ]
机构
[1] Istanbul Tech Univ, Dept Comp Engn, TR-34469 Istanbul, Turkey
关键词
Face hallucination; Super-resolution; Image decomposition; Subspace modeling; Learning based models; ACTIVE APPEARANCE MODELS; IMAGE REGISTRATION; RESOLUTION FRAMES; RESTORATION;
D O I
10.1016/j.patcog.2012.05.018
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a computationally efficient method for the super-resolution reconstruction of face images from their low-resolution versions. It is based on generative models and utilizes both the shape and texture components together. The main idea is that the image details can be synthesized by global modeling of accurately aligned local image regions. In order to achieve sufficient accuracy in alignment, shape reconstruction is considered as a separate problem and solved together with texture reconstruction in a coordinated manner. Meanwhile, the statistical dependency between the shape and texture components is also considered. Moreover, different from traditional model-based super-resolution methods, we use a corrected form of the degradation operator with the aligned images. We show that when the degradation is used with the aligned texture components as is, it causes bias in the reconstructions. To overcome this problem, we reflect the same processing performed in alignment onto the degradation operator and use this corrected version in texture reconstruction. Experimental results show that the proposed solution provides superior image reconstructions (both qualitatively and quantitatively) in a faster way. (C) 2012 Elsevier Ltd. All rights reserved.
引用
收藏
页码:4103 / 4116
页数:14
相关论文
共 30 条
  • [1] [Anonymous], 1989, Stat. Sci., DOI DOI 10.1214/SS/1177012582
  • [2] [Anonymous], 2006, Digital Image Processing
  • [3] Baker S., 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580), P83, DOI 10.1109/AFGR.2000.840616
  • [4] A generalized Gaussian image model for edge-preserving MAP estimation
    Bournan, Charles
    Sauer, Ken
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 1993, 2 (03) : 296 - 310
  • [5] Bradley C.J., 2007, The Algebra of Geometry: Cartesian, Areal and Projective Co-ordinates
  • [6] Capel D, 2001, PROC CVPR IEEE, P627
  • [7] Video epitomes
    Cheung, Vincent
    Frey, Brendan J.
    Jojic, Nebojsa
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2008, 76 (02) : 141 - 152
  • [8] ACTIVE SHAPE MODELS - THEIR TRAINING AND APPLICATION
    COOTES, TF
    TAYLOR, CJ
    COOPER, DH
    GRAHAM, J
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 1995, 61 (01) : 38 - 59
  • [9] Active appearance models
    Cootes, TF
    Edwards, GJ
    Taylor, CJ
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (06) : 681 - 685
  • [10] The asymmetry of image registration and its application to face tracking
    Dedeoglu, Goksel
    Kanade, Takeo
    Baker, Simon
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (05) : 807 - 823