Living-Skin Detection Based on Spatio-Temporal Analysis of Structured Light Pattern

被引:0
作者
Wang, Zhiyu [1 ]
Liao, Chuchu [2 ]
Pan, Liping [3 ]
Lu, Hongzhou [3 ]
Shan, Caifeng [1 ,4 ,5 ]
Wang, Wenjin [2 ]
机构
[1] Shandong Univ Sci & Technol, Coll Elect Engn & Automat, Qingdao 266590, Peoples R China
[2] Southern Univ Sci & Technol, Dept Biomed Engn, Shenzhen 518020, Peoples R China
[3] Third Peoples Hosp Shenzhen, Shenzhen 518115, Peoples R China
[4] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210023, Peoples R China
[5] Nanjing Univ, Sch Intelligence Sci & Technol, Nanjing 210023, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
Skin; Feature extraction; Brightness; Lasers; Faces; Image color analysis; Fluctuations; Living-skin detection; spatio-temporal feature; structured light; multilayer skin perception; NICU;
D O I
10.1109/JBHI.2024.3446193
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Living-skin detection is an important step for imaging photoplethysmography and biometric anti-spoofing. In this paper, we propose a new approach that exploits spatio-temporal characteristics of structured light patterns projected on the skin surface for living-skin detection. We observed that due to the interactions between laser photons and tissues inside a multi-layer skin structure, the frequency-domain sharpness feature of laser spots on skin and non-skin surfaces exhibits clear difference. Additionally, the subtle physiological motion of living-skin causes laser interference, leading to brightness fluctuations of laser spots projected on the skin surface. Based on these two observations, we designed a new living-skin detection algorithm to distinguish skin from non-skin using spatio-temporal features of structured laser spots. Experiments in the dark chamber and Neonatal Intensive Care Unit (NICU) demonstrated that the proposed setup and method performed well, achieving a precision of 85.32%, recall of 83.87%, and F1-score of 83.03% averaged over these two scenes. Compared to the approach that only leverages the property of multilayer skin structure, the hybrid approach obtains an averaged improvement of 8.18% in precision, 3.93% in recall, and 8.64% in F1-score. These results validate the efficacy of using frequency domain sharpness and brightness fluctuations to augment the features of living-skin tissues irradiated by structured light, providing a solid basis for structured light based physiological imaging.
引用
收藏
页码:6738 / 6750
页数:13
相关论文
共 53 条
  • [1] Skin Segmentation Using YUV and RGB Color Spaces
    Al-Tairi, Zaher Hamid
    Rahmat, Rahmita Wirza
    Saripan, M. Iqbal
    Sulaiman, Puteri Suhaiza
    [J]. JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2014, 10 (02): : 283 - 299
  • [2] PERFORMANCE OF OPTICAL-FLOW TECHNIQUES
    BARRON, JL
    FLEET, DJ
    BEAUCHEMIN, SS
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 1994, 12 (01) : 43 - 77
  • [3] A novel approach for human skin detection using convolutional neural network
    Ben Salah, Khawla
    Othmani, Mohamed
    Kherallah, Monji
    [J]. VISUAL COMPUTER, 2022, 38 (05) : 1833 - 1843
  • [4] SUNRISE: Improving 3D Mask Face Anti-Spoofing for Short Videos Using Pre-Emptive Split and Merge
    Birla, Lokendra
    Gupta, Puneet
    Kumar, Shravan
    [J]. IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2023, 20 (03) : 1927 - 1940
  • [5] Face Antispoofing Using Speeded-Up Robust Features and Fisher Vector Encoding
    Boulkenafet, Zinelabidine
    Komulainen, Jukka
    Hadid, Abdenour
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2017, 24 (02) : 141 - 145
  • [6] Bradley Derek, 2007, Journal of Graphics Tools, V12, P13
  • [7] Human skin detection through correlation rules between the YCb and YCr subspaces based on dynamic color clustering
    Brancati, Nadia
    De Pietro, Giuseppe
    Frucci, Maria
    Gallo, Luigi
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2017, 155 : 33 - 42
  • [8] Chen ZH, 2021, AAAI CONF ARTIF INTE, V35, P1132
  • [9] An adaptive real-time skin detector based on Hue thresholding: A comparison on two motion tracking methods
    Dadgostar, Farhad
    Sarrafzadeh, Abdolhossein
    [J]. PATTERN RECOGNITION LETTERS, 2006, 27 (12) : 1342 - 1352
  • [10] de Freitas Pereira Tiago, 2013, Computer Vision - ACCV 2012 Workshops. ACCV 2012 International Workshops. Revised Selected Papers, P121, DOI 10.1007/978-3-642-37410-4_11