ANNLR-FSR: Artificial Neural Network-Based Locality Regularization for Face Super-Resolution

被引:1
作者
Rai, Deepak [1 ]
Rajput, Shyam Singh [2 ]
机构
[1] Bennett Univ, Sch Comp Sci Engn & Technol, Greater Noida 201310, India
[2] Natl Inst Technol Patna, Dept Comp Sci & Engn, Patna 800005, India
关键词
Faces; Face recognition; Noise; Image reconstruction; Training; Noise level; Noise measurement; Position-patch; face super-resolution; face hallucination; noise; gaussian noise; artificial neural network; noise level estimation; GENERATIVE ADVERSARIAL NETWORK; IMAGE QUALITY ASSESSMENT; HALLUCINATION; ALGORITHM;
D O I
10.1109/TCE.2024.3408832
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In electronic surveillance, it is quite challenging to improve the resolution of consumer gadget's captured facial images which are often degraded by irregular noise. Although, there has been lot of research in the field of face super-resolution (FSR) published over past 20 years, but only a small percentage of them have concentrated on the issue of noisy FSR. Moreover, they reconstruct the noisy low-resolution (LR) faces without bothering about the actual noise level, which is essential for achieving state-of-the-art performance. Therefore, in this paper, an artificial neural network (ANN) based locality regularization technique for FSR is proposed named as ANNLR-FSR. In this, a noise level estimation model based on ANN is presented that precisely predicts the actual level of noise present in the test face. Further, the estimated noise is associated with the LR training images to make them structurally similar to the test face. This helps in obtaining noise-resistant reconstruction coefficients and achieving good super-resolution performance. Experiments are conducted on FEI, CelebA face datasets, and locally captured real-life faces to verify the performance of the proposed ANNLR-FSR technique. The obtained results evidently indicate that the proposed technique outperforms other compared state-of-the-art FSR methods.
引用
收藏
页码:5053 / 5064
页数:12
相关论文
共 62 条
[1]   SecureCam: Selective Detection and Encryption Enabled Application for Dynamic Camera Surveillance Videos [J].
Aribilola, Ifeoluwapo ;
Asghar, Mamoona Naveed ;
Kanwal, Nadia ;
Fleury, Martin ;
Lee, Brian .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2023, 69 (02) :156-169
[2]  
Baker S., 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580), P83, DOI 10.1109/AFGR.2000.840616
[3]   GLEAN: Generative Latent Bank for Image Super-Resolution and Beyond [J].
Chan, Kelvin C. K. ;
Xu, Xiangyu ;
Wang, Xintao ;
Gu, Jinwei ;
Loy, Chen Change .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) :3154-3168
[4]   Super-resolution through neighbor embedding [J].
Chang, H ;
Yeung, DY ;
Xiong, Y .
PROCEEDINGS OF THE 2004 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, 2004, :275-282
[5]   Learning Spatial Attention for Face Super-Resolution [J].
Chen, Chaofeng ;
Gong, Dihong ;
Wang, Hao ;
Li, Zhifeng ;
Wong, Kwan-Yee K. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :1219-1231
[6]   FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors [J].
Chen, Yu ;
Tai, Ying ;
Liu, Xiaoming ;
Shen, Chunhua ;
Yang, Jian .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2492-2501
[7]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[8]   TRAINING FEEDFORWARD NETWORKS WITH THE MARQUARDT ALGORITHM [J].
HAGAN, MT ;
MENHAJ, MB .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (06) :989-993
[9]   Wavelet Domain Generative Adversarial Network for Multi-scale Face Hallucination [J].
Huang, Huaibo ;
He, Ran ;
Sun, Zhenan ;
Tan, Tieniu .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2019, 127 (6-7) :763-784
[10]   Robust Single-Image Super-Resolution Based on Adaptive Edge-Preserving Smoothing Regularization [J].
Huang, Shuying ;
Sun, Jun ;
Yang, Yong ;
Fang, Yuming ;
Lin, Pan ;
Que, Yue .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (06) :2650-2663