OEINR-RFH: Outlier elimination based iterative neighbor representation for robust face hallucination

被引:5
作者
Rajput, Shyam Singh [1 ]
Rai, Deepak [1 ,2 ]
Kumar, Banti [1 ]
机构
[1] Natl Inst Technol Patna, Dept CSE, Patna, Bihar, India
[2] Bennett Univ, Sch CSET, Greater Noida, Uttar Pradesh, India
关键词
Impulse noise robust; Super-resolution; Low-resolution problem; Face hallucination; Image reconstruction; Image processing; GENERATIVE ADVERSARIAL NETWORK; IMAGE SUPERRESOLUTION; ALGORITHM;
D O I
10.1016/j.eswa.2023.121553
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
To make the face hallucination process robust to impulse noise, a new outlier elimination based iterative neighbor representation (OEINR) algorithm is proposed in this work. The proposed algorithm computes the fidelity in the low-resolution (LR) space and the locality adaptor in the high-resolution (HR) space. It helps the proposed algorithm in obtaining better reconstruction weights and preserving individual characteristics of an input in the output faces. To compute the HR space-based locality adaptor, an HR face (named the assisting face) is generated by proposing a new objective function utilizing the merits of sparsity. Further, the iterative approach is applied to continuously improve the quality of the assisting face which succors in achieving better locality constraint, and hence better reconstruction weights. Moreover, outliers (impulse noise-contaminated pixels) are eliminated from weights calculation as well as the assisting face generation process which helps the proposed algorithm in minimizing the effect of impulse noise. The results obtained from the experiments conducted on public FEI, CAS+PEAL, CMU+MIT face databases, and surveillance videos and images exhibit the superiority of the proposed OEINR algorithm over existing comparative face hallucination methods.
引用
收藏
页数:17
相关论文
共 78 条
[1]   Face image super-resolution using 2D CCA [J].
An, Le ;
Bhanu, Bir .
SIGNAL PROCESSING, 2014, 103 :184-194
[2]  
Baker S., 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580), P83, DOI 10.1109/AFGR.2000.840616
[3]   Attention-Aware Face Hallucination via Deep Reinforcement Learning [J].
Cao, Qingxing ;
Lin, Liang ;
Shi, Yukai ;
Liang, Xiaodan ;
Li, Guanbin .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1656-1664
[4]   Super-resolution of face images using kernel PCA-based prior [J].
Chakrabarti, Ayan ;
Rajagopalan, A. N. ;
Chellappa, Rama .
IEEE TRANSACTIONS ON MULTIMEDIA, 2007, 9 (04) :888-892
[5]   Super-resolution through neighbor embedding [J].
Chang, H ;
Yeung, DY ;
Xiong, Y .
PROCEEDINGS OF THE 2004 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, 2004, :275-282
[6]   Learning Spatial Attention for Face Super-Resolution [J].
Chen, Chaofeng ;
Gong, Dihong ;
Wang, Hao ;
Li, Zhifeng ;
Wong, Kwan-Yee K. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :1219-1231
[7]   Weighted Couple Sparse Representation With Classified Regularization for Impulse Noise Removal [J].
Chen, Chun Lung Philip ;
Liu, Licheng ;
Chen, Long ;
Tang, Yuan Yan ;
Zhou, Yicong .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (11) :4014-4026
[8]   A novel face super resolution approach for noisy images using contour feature and standard deviation prior [J].
Chen, Liang ;
Hu, Ruimin ;
Liang, Chao ;
Li, Qing ;
Han, Zhen .
MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (02) :2467-2493
[9]   Adaptive impulse detection using center-weighted median filters [J].
Chen, T ;
Wu, HR .
IEEE SIGNAL PROCESSING LETTERS, 2001, 8 (01) :1-3
[10]   FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors [J].
Chen, Yu ;
Tai, Ying ;
Liu, Xiaoming ;
Shen, Chunhua ;
Yang, Jian .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2492-2501