IPAS-Net: A deep-learning model for generating high-fidelity shoeprints from low-quality images with no natural references

被引:4
作者
Hassan, Muhammad [1 ,5 ]
Wang, Yan [1 ,5 ]
Pang, Wei [3 ]
Wang, Di [2 ]
Li, Daixi [4 ]
Zhou, You [1 ,5 ]
Xu, Dong [6 ]
机构
[1] Jilin Univ, Coll Comp Sci & Technol, Changchun, Peoples R China
[2] Nanyang Technol Univ, Joint NTU UBC Res Ctr Excellence Act Living Elderl, Singapore, Singapore
[3] Heriot Watt Univ, Sch Math & Comp Sci, Edinburgh, Scotland
[4] Everspray Sci & Technol Co Ltd, Dalian, Peoples R China
[5] Minist Educ, Key Lab Symbol Computat & Knowledge Engn, Changchun, Peoples R China
[6] Univ Missouri, Bond Life Sci Ctr, Dept Elect Engn & Comp Sci, Columbia, MO USA
基金
中国国家自然科学基金;
关键词
Shoeprint; Super-resolution; Forensics; Naturalness; Parameters sharing; Attention; Upscaling; SUPERRESOLUTION; RECONSTRUCTION;
D O I
10.1016/j.jksuci.2022.03.024
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Single image super-resolution (SISR) typically reconstructs higher-resolution (HR) images from the corresponding low-resolution (LR) images in the presence of natural HR images. SISR is highly important in generating high-quality images in forensic scenarios since it facilitates close investigation and examination of captured shoeprints. However, it becomes more challenging when there are no available natural HR ground truth images that correspond to the input LR images. In such cases, HR reconstruction becomes even more crucial for providing HR versions that retain the natural characteristics of shoeprints. For this purpose, we propose IPAS-Net, which utilizes U-Net for feature extraction, shares the learned parameters from LR space in HR space, and innovatively upscales, refines, and enhances the HR space via special treatments. The upsampling-and-refinement block comprises a parallel pipeline composed of attention mechanism block (AMB) and one-step-high-iteration (OSHI). All upsampling solutions are infused so that distinct upscaling can compensate each others' weaknesses. The generated HR shoeprints are evaluated using blind/non-reference evaluation metrics, and the proposed method outperforms the state of the art (SOTA) deep learning modalities on low-quality shoeprints.(c) 2022 The Author(s). Published by Elsevier B.V. on behalf of King Saud University. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页码:2743 / 2757
页数:15
相关论文
共 68 条
  • [1] COMPUTATIONAL INTELLIGENCE FOR SHOEPRINT RECOGNITION
    Acevedo Mosqueda, M. E.
    Acevedo Mosqueda, M. A.
    Carreno Aguilera, R.
    Martinez Zuniga, F.
    Pacheco Bautista, D.
    Patino Ortiz, M.
    Yu, Wen
    [J]. FRACTALS-COMPLEX GEOMETRY PATTERNS AND SCALING IN NATURE AND SOCIETY, 2019, 27 (04)
  • [2] A novel technique for automatic shoeprint image retrieval
    AlGarni, Gharsa
    Hamiane, Madina
    [J]. FORENSIC SCIENCE INTERNATIONAL, 2008, 181 (1-3) : 10 - 14
  • [3] Crime scene reconstruction-Sex prediction from blood stained foot sole impressions
    Basu, Nabanita
    Bandyopadhyay, Samir Kumar
    [J]. FORENSIC SCIENCE INTERNATIONAL, 2017, 278 : 156 - 172
  • [4] To Learn Image Super-Resolution, Use a GAN to Learn How to Do Image Degradation First
    Bulat, Adrian
    Yang, Jing
    Tzimiropoulos, Georgios
    [J]. COMPUTER VISION - ECCV 2018, PT VI, 2018, 11210 : 187 - 202
  • [5] GLEAN: Generative Latent Bank for Large-Factor Image Super-Resolution
    Chan, Kelvin C. K.
    Wang, Xintao
    Xu, Xiangyu
    Gu, Jinwei
    Loy, Chen Change
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 14240 - 14249
  • [6] Statistical Iterative CBCT Reconstruction Based on Neural Network
    Chen, Binbin
    Xiang, Kai
    Gong, Zaiwen
    Wang, Jing
    Tan, Shan
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) : 1511 - 1521
  • [7] Image Super-Resolution Using Deep Convolutional Networks
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) : 295 - 307
  • [8] A Variational U-Net for Conditional Appearance and Shape Generation
    Esser, Patrick
    Sutter, Ekaterina
    Ommer, Bjoern
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8857 - 8866
  • [9] FRANCIS X, 2019, 2019 IEEE INT S SIGN, P1
  • [10] Learning Wear Patterns on Footwear Outsoles Using Convolutional Neural Networks
    Francis, Xavier
    Sharifzadeh, Hamid
    Newton, Angus
    Baghaei, Nilufar
    Varastehpour, Soheil
    [J]. 2019 18TH IEEE INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS/13TH IEEE INTERNATIONAL CONFERENCE ON BIG DATA SCIENCE AND ENGINEERING (TRUSTCOM/BIGDATASE 2019), 2019, : 450 - 457