Machine Learning Analysis of Human Skin by Optoacoustic Mesoscopy for Automated Extraction of Psoriasis and Aging Biomarkers

被引:3
|
作者
He, Hailong [1 ,2 ]
Paetzold, Johannes C. [3 ]
Boerner, Nils [4 ]
Riedel, Erik [1 ,2 ]
Gerl, Stefan [4 ]
Schneider, Simon [5 ]
Fisher, Chiara [1 ,2 ]
Ezhov, Ivan [4 ]
Shit, Suprosanna [4 ]
Li, Hongwei [4 ]
Ruckert, Daniel [3 ,6 ]
Aguirre, Juan [7 ,8 ]
Biedermann, Tilo [5 ]
Darsow, Ulf [5 ]
Menze, Bjoern [9 ]
Ntziachristos, Vasilis [1 ,10 ,11 ]
机构
[1] Helmholtz Zentrum Munchen, Inst Biol & Med Imaging, D-85764 Neuherberg, Germany
[2] Tech Univ Munich, Cent Inst Translat Canc Res TranslaTUM, Chair Biol Imaging, Sch Med, D-81675 Munich, Germany
[3] Imperial Coll London, Dept Comp, London SW7 2RH, England
[4] Tech Univ Munich, Dept Comp Sci, D-81541 Munich, Germany
[5] Tech Univ Munich, Dept Dermatol & Allergy, D-80337 Munich, Germany
[6] Tech Univ Munich, Dept Comp Sci, D-81675 Munich, Germany
[7] Univ Autonoma Madrid, Dept Tecnol Elect & Comunicac, Madrid 28049, Spain
[8] Inst Invest Sanitaria Fdn Jimenez Diaz, Madrid 28015, Spain
[9] Univ Zurich, Dept Quant Biomed, CH-8006 Zurich, Switzerland
[10] Tech Univ Munich, Cent Inst Translat Canc Res TranslaTUM, Chair Biol Imaging, Sch Med, D-81675 Munich, Germany
[11] Tech Univ Munich, Munich Inst Robot & Machine Intelligence MIRMI, D-80992 Munich, Germany
基金
欧盟地平线“2020”;
关键词
Skin; Image segmentation; Imaging; Feature extraction; Biomarkers; Morphology; Image reconstruction; Optoacoustic mesoscopy; photoacoustic; skin imaging; skin aging; segmentation; machine learning; OPTICAL COHERENCE TOMOGRAPHY; DIAGNOSIS;
D O I
10.1109/TMI.2024.3356180
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Ultra-wideband raster-scan optoacoustic mesoscopy (RSOM) is a novel modality that has demonstrated unprecedented ability to visualize epidermal and dermal structures in-vivo. However, an automatic and quantitative analysis of three-dimensional RSOM datasets remains unexplored. In this work we present our framework: Deep Learning RSOM Analysis Pipeline (DeepRAP), to analyze and quantify morphological skin features recorded by RSOM and extract imaging biomarkers for disease characterization. DeepRAP uses a multi-network segmentation strategy based on convolutional neural networks with transfer learning. This strategy enabled the automatic recognition of skin layers and subsequent segmentation of dermal microvasculature with an accuracy equivalent to human assessment. DeepRAP was validated against manual segmentation on 25 psoriasis patients under treatment and our biomarker extraction was shown to characterize disease severity and progression well with a strong correlation to physician evaluation and histology. In a unique validation experiment, we applied DeepRAP in a time series sequence of occlusion-induced hyperemia from 10 healthy volunteers. We observe how the biomarkers decrease and recover during the occlusion and release process, demonstrating accurate performance and reproducibility of DeepRAP. Furthermore, we analyzed a cohort of 75 volunteers and defined a relationship between aging and microvascular features in-vivo. More precisely, this study revealed that fine microvascular features in the dermal layer have the strongest correlation to age. The ability of our newly developed framework to enable the rapid study of human skin morphology and microvasculature in-vivo promises to replace biopsy studies, increasing the translational potential of RSOM.
引用
收藏
页码:2074 / 2085
页数:12
相关论文
共 50 条
  • [41] Human body skin temperature prediction based on machine learning
    Shin Morishima
    Yingjie Xu
    Akira Urashima
    Tomoji Toriyama
    Artificial Life and Robotics, 2021, 26 : 103 - 108
  • [42] Estimation of the degree of hydration of concrete through automated machine learning based microstructure analysis - A study on effect of image magnification
    Bangaru, Srikanth Sagar
    Wang, Chao
    Hassan, Marwa
    Jeon, Hyun Woo
    Ayiluri, Tarun
    ADVANCED ENGINEERING INFORMATICS, 2019, 42
  • [43] Automated Extraction of Skin Wound Healing Biomarkers From In Vivo Label-Free Multiphoton Microscopy Using Convolutional Neural Networks
    Jones, Jake D.
    Rodriguez, Marcos R.
    Quinn, Kyle P.
    LASERS IN SURGERY AND MEDICINE, 2021, 53 (08) : 1086 - 1095
  • [44] Prostate cancer tissue classification by multiphoton imaging, automated image analysis and machine learning
    Gomes, Egleidson F. A.
    Paulino Junior, Eduardo
    de Lima, Mario F. R.
    Reis, Luana A.
    Paranhos, Giovanna
    Mamede, Marcelo
    Longford, Francis G. J.
    Frey, Jeremy G.
    de Paula, Ana Maria
    JOURNAL OF BIOPHOTONICS, 2023, 16 (06)
  • [45] Machine learning approach for automated data analysis in tilted FBGs
    Leal-Junior, Arnaldo
    Avellar, Leandro
    Frizera, Anselmo
    Caucheteur, Christophe
    Marques, Carlos
    OPTICAL FIBER TECHNOLOGY, 2024, 84
  • [46] Automated Analysis of Reflection in Writing: Validating Machine Learning Approaches
    Ullmann, Thomas Daniel
    INTERNATIONAL JOURNAL OF ARTIFICIAL INTELLIGENCE IN EDUCATION, 2019, 29 (02) : 217 - 257
  • [47] Automated Analysis of Reflection in Writing: Validating Machine Learning Approaches
    Thomas Daniel Ullmann
    International Journal of Artificial Intelligence in Education, 2019, 29 : 217 - 257
  • [48] Automated proliferation index calculation for skin melanoma biopsy images using machine learning
    Alheejawi, Salah
    Berendt, Richard
    Jha, Naresh
    Maity, Santi P.
    Mandal, Mrinal
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2021, 89
  • [49] Fusion Mechanisms for Human Activity Recognition Using Automated Machine Learning
    Popescu, Ana-Cosmina
    Mocanu, Irina
    Cramariuc, Bogdan
    IEEE ACCESS, 2020, 8 : 143996 - 144014
  • [50] Automated Neoclassical Vertical Canon Validation in Human Faces with Machine Learning
    Mehta, Ashwinee
    Abdelaal, Maged
    Sheba, Moamen
    Herndon, Nic
    PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON DATA SCIENCE, TECHNOLOGY AND APPLICATIONS (DATA), 2022, : 461 - 467