Robust Face Hallucination via Locality-Constrained Bi-Layer Representation

被引:56
作者
Liu, Licheng [1 ]
Chen, C. L. Philip [2 ]
Li, Shutao [1 ]
Tang, Yuan Yan [2 ]
Chen, Long [2 ]
机构
[1] Hunan Univ, Coll Elect & Informat Engn, Changsha 410082, Hunan, Peoples R China
[2] Univ Macau, Dept Comp & Informat Sci, Macau 999078, Peoples R China
基金
中国国家自然科学基金;
关键词
Bi-layer representation; face hallucination; locality-constrained coding; robust coding; SUPERRESOLUTION; NOISE; REGULARIZATION; DICTIONARY; RESOLUTION; REMOVAL; NETWORK; IMAGES; FILTER; MODEL;
D O I
10.1109/TCYB.2017.2682853
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, locality-constrained linear coding (LLC) has been drawn great attentions and been widely used in image processing and computer vision tasks. However, the conventional LLC model is always fragile to outliers. In this paper, we present a robust locality-constrained bi-layer representation model to simultaneously hallucinate the face images and suppress noise and outliers with the assistant of a group of training samples. The proposed scheme is not only able to capture the nonlinear manifold structure but also robust to outliers by incorporating a weight vector into the objective function to subtly tune the contribution of each pixel offered in the objective. Furthermore, a high-resolution (HR) layer is employed to compensate the missed information in the low-resolution (LR) space for coding. The use of two layers (the LR layer and the HR layer) is expected to expose the complicated correlation between the LR and HR patch spaces, which helps to obtain the desirable coefficients to reconstruct the final HR face. The experimental results demonstrate that the proposed method outperforms the state-of-the-art image super-resolution methods in terms of both quantitative measurements and visual effects.
引用
收藏
页码:1189 / 1201
页数:13
相关论文
共 60 条
[1]   Removal of High-Density Salt-and-Pepper Noise in Images With an Iterative Adaptive Fuzzy Filter Using Alpha-Trimmed Mean [J].
Ahmed, Faruk ;
Das, Swagatam .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2014, 22 (05) :1352-1358
[2]  
[Anonymous], P IEEE INT C MULT EX
[3]  
Baker S., 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580), P83, DOI 10.1109/AFGR.2000.840616
[4]   Limits on super-resolution and how to break them [J].
Baker, S ;
Kanade, T .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (09) :1167-1183
[5]   Super-resolution of face images using kernel PCA-based prior [J].
Chakrabarti, Ayan ;
Rajagopalan, A. N. ;
Chellappa, Rama .
IEEE TRANSACTIONS ON MULTIMEDIA, 2007, 9 (04) :888-892
[6]   Super-resolution through neighbor embedding [J].
Chang, H ;
Yeung, DY ;
Xiong, Y .
PROCEEDINGS OF THE 2004 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, 2004, :275-282
[7]   Weighted Couple Sparse Representation With Classified Regularization for Impulse Noise Removal [J].
Chen, Chun Lung Philip ;
Liu, Licheng ;
Chen, Long ;
Tang, Yuan Yan ;
Zhou, Yicong .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (11) :4014-4026
[8]   A robust bi-sparsity model with non-local regularization for mixed noise reduction [J].
Chen, Long ;
Liu, Licheng ;
Chen, C. L. Philip .
INFORMATION SCIENCES, 2016, 354 :101-111
[9]   Adaptive impulse detection using center-weighted median filters [J].
Chen, T ;
Wu, HR .
IEEE SIGNAL PROCESSING LETTERS, 2001, 8 (01) :1-3
[10]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307