Digital Staining of High-Definition Fourier Transform Infrared (FT-IR) Images Using Deep Learning

被引:24
作者
Lotfollahi, Mahsa [1 ]
Berisha, Sebastian [1 ]
Daeinejad, Davar [1 ]
Mayerich, David [1 ]
机构
[1] Univ Houston, Dept Elect & Comp Engn, Houston, TX 77004 USA
关键词
Histology; histopathology; digital staining; deep learning; convolutional neural networks; classification; Fourier transform infrared; FT-IR; RAMAN-SPECTROSCOPY; TISSUE; CELLS; DIAGNOSIS;
D O I
10.1177/0003702818819857
中图分类号
TH7 [仪器、仪表];
学科分类号
0804 ; 080401 ; 081102 ;
摘要
Histological stains, such as hematoxylin and eosin (H&E), are routinely used in clinical diagnosis and research. While these labels offer a high degree of specificity, throughput is limited by the need for multiple samples. Traditional histology stains, such as immunohistochemical labels, also rely only on protein expression and cannot quantify small molecules and metabolites that may aid in diagnosis. Finally, chemical stains and dyes permanently alter the tissue, making downstream analysis impossible. Fourier transform infrared (FT-IR) spectroscopic imaging has shown promise for label-free characterization of important tissue phenotypes and can bypass the need for many chemical labels. Fourier transform infrared classification commonly leverages supervised learning, requiring human annotation that is tedious and prone to errors. One alternative is digital staining, which leverages machine learning to map IR spectra to a corresponding chemical stain. This replaces human annotation with computer-aided alignment. Previous work relies on alignment of adjacent serial tissue sections. Since the tissue samples are not identical at the cellular level, this technique cannot be applied to high-definition FT-IR images. In this paper, we demonstrate that cellular-level mapping can be accomplished using identical samples for both FT-IR and chemical labels. In addition, higher-resolution results can be achieved using a deep convolutional neural network that integrates spatial and spectral features.
引用
收藏
页码:556 / 564
页数:9
相关论文
共 56 条
  • [1] AlZubaidi Abbas K., 2017, 2017 Annual Conference on New Trends in Information & Communications Technology Applications (NTICT), P219, DOI 10.1109/NTICT.2017.7976109
  • [2] [Anonymous], ARXIV171005719
  • [3] [Anonymous], 2015, Nature, DOI [10.1038/nature14539, DOI 10.1038/NATURE14539]
  • [4] [Anonymous], ICCV WORKSH
  • [5] [Anonymous], FOUNDATIONS AND TREN
  • [6] [Anonymous], VIBRATIONAL SPECTROS
  • [7] [Anonymous], 2005, Technical report
  • [8] Raman Spectroscopy of Blood and Blood Components
    Atkins, Chad G.
    Buckley, Kevin
    Blades, Michael W.
    Turner, Robin F. B.
    [J]. APPLIED SPECTROSCOPY, 2017, 71 (05) : 767 - 793
  • [9] Using Fourier transform IR spectroscopy to analyze biological materials
    Baker, Matthew J.
    Trevisan, Julio
    Bassan, Paul
    Bhargava, Rohit
    Butler, Holly J.
    Dorling, Konrad M.
    Fielden, Peter R.
    Fogarty, Simon W.
    Fullwood, Nigel J.
    Heys, Kelly A.
    Hughes, Caryn
    Lasch, Peter
    Martin-Hirsch, Pierre L.
    Obinaju, Blessing
    Sockalingum, Ganesh D.
    Sule-Suso, Josep
    Strong, Rebecca J.
    Walsh, Michael J.
    Wood, Bayden R.
    Gardner, Peter
    Martin, Francis L.
    [J]. NATURE PROTOCOLS, 2014, 9 (08) : 1771 - 1791
  • [10] Infrared imaging in breast cancer: automated tissue component recognition and spectral characterization of breast cancer cells as well as the tumor microenvironment
    Benard, Audrey
    Desmedt, Christine
    Smolina, Margarita
    Szternfeld, Philippe
    Verdonck, Magali
    Rouas, Ghizlane
    Kheddoumi, Naima
    Rothe, Francoise
    Larsimont, Denis
    Sotiriou, Christos
    Goormaghtigh, Erik
    [J]. ANALYST, 2014, 139 (05) : 1044 - 1056