Robust Face Hallucination Algorithm Using Motion Blur Embedded Nearest Proximate Patch Representation

被引:9
|
作者
Rai, Deepak [1 ]
Rajput, Shyam Singh [1 ]
机构
[1] Natl Inst Technol Patna, Dept Comp Sci & Engn, Patna 800005, Bihar, India
关键词
Faces; Training; Face recognition; Kernel; Image reconstruction; Image resolution; Generative adversarial networks; Face hallucination (FH); motion-blur; position-patch; proximate patch; super-resolution (SR); SUPERRESOLUTION; LIMITS;
D O I
10.1109/TIM.2022.3223141
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Face hallucination (FH) techniques have received a lot of attention in recent years for generating high-resolution (HR) face images from captured low-resolution (LR), noisy, and blurry images. However, existing FH techniques are incapable of dealing with motion blur, which is commonly introduced in captured images due to camera defocussing and other factors. Therefore, to make the FH process more resistant to motion blur, in this article, we present a novel learning-based FH algorithm called Motion Blur Embedded Nearest Proximate Patch Representation (MBENPPR). The MBENPPR algorithm begins by estimating the motion blur kernel from a motion-blurred LR test face. The estimated kernel is then embedded in training images to make them compatible with test images. It assists in reducing the effect of motion blur in the reconstruction process. Furthermore, the nearest proximate patches are selected from the training space to represent the test image patches as a weighted linear combination of selected patches. It facilitates the proposed algorithm in preserving sharp edges and texture information in the resulting faces. The results of simulations on standard datasets and locally captured real-life faces show that the MBENPPR algorithm outperforms the compared existing algorithms.
引用
收藏
页数:10
相关论文
共 35 条
  • [1] Robust Face Hallucination Algorithm Using Motion Blur Embedded Nearest Proximate Patch Representation
    Rai, Deepak
    Rajput, Shyam Singh
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [2] Robust Face Hallucination Algorithm Using Motion Blur Embedded Nearest Proximate Patch Representation
    Rai, Deepak
    Rajput, Shyam Singh
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [3] Noise Robust Face Hallucination Based on Smooth Correntropy Representation
    Liu, Licheng
    Feng, Qiying
    Chen, C. L. Philip
    Wang, Yaonan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (10) : 5953 - 5965
  • [4] Modal Regression-Based Graph Representation for Noise Robust Face Hallucination
    Liu, Licheng
    Chen, C. L. Philip
    Wang, Yaonan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (05) : 2490 - 2502
  • [5] Noise robust face hallucination algorithm using local content prior based error shrunk nearest neighbors representation
    Rajput, Shyam Singh
    Singh, Ankur
    Arya, K. V.
    Jiang, Junjun
    SIGNAL PROCESSING, 2018, 147 : 233 - 246
  • [6] Noise Robust Face Hallucination via Locality-Constrained Representation
    Jiang, Junjun
    Hu, Ruimin
    Wang, Zhongyuan
    Han, Zhen
    IEEE TRANSACTIONS ON MULTIMEDIA, 2014, 16 (05) : 1268 - 1281
  • [7] Robust 3D Patch-Based Face Hallucination
    Qu, Chengchao
    Herrmann, Christian
    Monari, Eduardo
    Schuchert, Tobias
    Beyerer, Jurgen
    2017 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2017), 2017, : 1105 - 1114
  • [8] EIGEN-PATCH: POSITION-PATCH BASED FACE HALLUCINATION USING EIGEN TRANSFORMATION
    Chen, Hong-Yuh
    Chien, Shao-Yi
    2014 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2014,
  • [9] Context-Patch Representation Learning With Adaptive Neighbor Embedding for Robust Face Image Super-Resolution
    Gao, Guangwei
    Yu, Yi
    Lu, Huimin
    Yang, Jian
    Yue, Dong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 1879 - 1889
  • [10] OEINR-RFH: Outlier elimination based iterative neighbor representation for robust face hallucination
    Rajput, Shyam Singh
    Rai, Deepak
    Kumar, Banti
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 237