Hallucinating faces: LPH super-resolution and neighbor reconstruction for residue compensation

被引:114
作者
Zhuang, Yueting [1 ]
Zhang, Jian [1 ]
Wu, Fei [1 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310027, Peoples R China
基金
中国国家自然科学基金;
关键词
face hallucination; super-resolution; locality preserving hallucination; residue patch; training image pairs;
D O I
10.1016/j.patcog.2007.03.011
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A two-phase face hallucination approach is proposed in this paper to infer high-resolution face image from the low-resolution observation based on a set of training image pairs. The proposed locality preserving hallucination (LPH) algorithm combines locality preserving projection (LPP) and radial basis function (RBF) regression together to hallucinate the global high-resolution face. Furthermore, in order to compensate the inferred global face with detailed inartificial facial features, the neighbor reconstruction based face residue hallucination is used. Compared with existing approaches, the proposed LPH algorithm can generate global face more similar to the ground truth face efficiently, moreover, the patch structure and search strategy carefully designed for the neighbor reconstruction algorithm greatly reduce the computational complexity without diminishing the quality of high-resolution face detail. The details of synthetic high-resolution face are further improved by a global linear smoother. Experiments indicate that our approach can synthesize distinct high-resolution faces with various facial appearances such as facial expressions, eyeglasses efficiently. (c) 2007 Pattern Recognition Society. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:3178 / 3194
页数:17
相关论文
共 25 条
[1]  
[Anonymous], P 3 INT C IM GRAPH H
[2]  
Baker S., 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580), P83, DOI 10.1109/AFGR.2000.840616
[3]  
Balasubramanian M, 2002, SCIENCE, V295
[4]  
Belkin M, 2002, ADV NEUR IN, V14, P585
[5]  
BONET JD, 1997, P SIGGRAPH 97, P361
[6]   Super-resolution through neighbor embedding [J].
Chang, H ;
Yeung, DY ;
Xiong, Y .
PROCEEDINGS OF THE 2004 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, 2004, :275-282
[7]  
Chang Y, 2004, PROC CVPR IEEE, P520
[8]   Manifold based analysis of facial expression [J].
Chang, Ya ;
Hu, Changbo ;
Feris, Rogerio ;
Turk, Matthew .
IMAGE AND VISION COMPUTING, 2006, 24 (06) :605-614
[9]  
DONG H, 2001, PF01 POH U SCI TECHN
[10]  
Freeman W. T., 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision, P1182, DOI 10.1109/ICCV.1999.790414