Computational Histological Staining and Destaining of Prostate Core Biopsy RGB Images with Generative Adversarial Neural Networks

被引:41
|
作者
Rana, Aman [1 ]
Yaunery, Gregory [1 ]
Lowe, Alarice [2 ]
Shah, Pratik [1 ]
机构
[1] MIT, Media Lab, Cambridge, MA 02139 USA
[2] Harvard Med Sch, Brigham & Womens Hosp, Boston, MA 02115 USA
来源
2018 17TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA) | 2018年
关键词
digital histopathology; computational staining; deep learning; H&E staining; GAN; prostate core biopsy;
D O I
10.1109/ICMLA.2018.00133
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Histopathology tissue samples are widely available in two states: paraffin-embedded unstained and non-paraffin-embedded stained whole slide RGB images (WSRI). Hematoxylin and eosin stain (H&E) is one of the principal stains in histology but suffers from several shortcomings related to tissue preparation, staining protocols, slowness and human error. We report two novel approaches for training machine learning models for the computational H&E staining and destaining of prostate core biopsy RGB images. The staining model uses a conditional generative adversarial network that learns hierarchical non-linear mappings between whole slide RGB image (WSRI) pairs of prostate core biopsy before and after H&E staining. The trained staining model can then generate computationally H&E-stained prostate core WSRIs using previously unseen non-stained biopsy images as input. The destaining model, by learning mappings between an H&E stained WSRI and a non-stained WSRI of the same biopsy, can computationally destain previously unseen H&E-stained images. Structural and anatomical details of prostate tissue and colors, shapes, geometries, locations of nuclei, stroma, vessels, glands and other cellular components were generated by both models with structural similarity indices of 0.68 (staining) and 0.84 (destaining). The proposed staining and destaining models can engender computational H&E staining and destaining of WSRI biopsies without additional equipment and devices.
引用
收藏
页码:828 / 834
页数:7
相关论文
共 33 条
  • [1] High-Resolution Generative Adversarial Neural Networks Applied to Histological Images Generation
    Mauricio, Antoni
    Lopez, Jorge
    Huauya, Roger
    Diaz, Jose
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2018, PT II, 2018, 11140 : 195 - 202
  • [2] Human Mesh Reconstruction with Generative Adversarial Networks from Single RGB Images
    Gao, Rui
    Wen, Mingyun
    Park, Jisun
    Cho, Kyungeun
    SENSORS, 2021, 21 (04) : 1 - 17
  • [3] Unpaired virtual histological staining using prior-guided generative adversarial networks
    Yan, Renao
    He, Qiming
    Liu, Yiqing
    Ye, Peng
    Zhu, Lianghui
    Shi, Shanshan
    Gou, Jizhou
    He, Yonghong
    Guan, Tian
    Zhou, Guangde
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2023, 105
  • [4] Digital Core Modeling Based on Pretrained Generative Adversarial Neural Networks
    Zhang, Qing
    Wang, Benqiang
    Liang, Xusheng
    Li, Yizhen
    He, Feng
    Hao, Yuexiang
    GEOFLUIDS, 2022, 2022
  • [5] A Computationally Virtual Histological Staining Method to Ovarian Cancer Tissue by Deep Generative Adversarial Networks
    Meng, Xiangyu
    Li, Xin
    Wang, Xun
    COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2021, 2021
  • [6] Use of Deep Learning to Develop and Analyze Computational Hematoxylin and Eosin Staining of Prostate Core Biopsy Images for Tumor Diagnosis
    Rana, Aman
    Lowe, Alarice
    Lithgow, Marie
    Horback, Katharine
    Janovitz, Tyler
    Da Silva, Annacarolina
    Tsai, Harrison
    Shanmugam, Vignesh
    Bayat, Akram
    Shah, Pratik
    JAMA NETWORK OPEN, 2020, 3 (05)
  • [7] Normalization of HE-stained histological images using cycle consistent generative adversarial networks
    Marlen Runz
    Daniel Rusche
    Stefan Schmidt
    Martin R. Weihrauch
    Jürgen Hesser
    Cleo-Aron Weis
    Diagnostic Pathology, 16
  • [8] Normalization of HE-stained histological images using cycle consistent generative adversarial networks
    Runz, Marlen
    Rusche, Daniel
    Schmidt, Stefan
    Weihrauch, Martin R.
    Hesser, Juergen
    Weis, Cleo-Aron
    DIAGNOSTIC PATHOLOGY, 2021, 16 (01)
  • [9] pix2xray: converting RGB images into X-rays using generative adversarial networks
    Mustafa Haiderbhai
    Sergio Ledesma
    Sing Chun Lee
    Matthias Seibold
    Phillipp Fürnstahl
    Nassir Navab
    Pascal Fallavollita
    International Journal of Computer Assisted Radiology and Surgery, 2020, 15 : 973 - 980
  • [10] pix2xray: converting RGB images into X-rays using generative adversarial networks
    Haiderbhai, Mustafa
    Ledesma, Sergio
    Lee, Sing Chun
    Seibold, Matthias
    Fuernstahl, Phillipp
    Navab, Nassir
    Fallavollita, Pascal
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2020, 15 (06) : 973 - 980