Unpaired virtual histological staining using prior-guided generative adversarial networks

被引:11
|
作者
Yan, Renao [1 ]
He, Qiming [1 ]
Liu, Yiqing [1 ]
Ye, Peng [1 ]
Zhu, Lianghui [1 ]
Shi, Shanshan [1 ]
Gou, Jizhou [2 ]
He, Yonghong [1 ]
Guan, Tian [1 ]
Zhou, Guangde [2 ]
机构
[1] Tsinghua Univ, Shenshen Int Grad Sch, Shenzhen 518055, Guangdong, Peoples R China
[2] Third Peoples Hosp Shenzhen, Buji Buren Rd 29, Shenzhen 518112, Guangdong, Peoples R China
关键词
Histopathology; Stain translation; Generative adversarial network (GAN); Masson trichrome; LIVER FIBROSIS; IMAGE-ANALYSIS; QUANTIFICATION;
D O I
10.1016/j.compmedimag.2023.102185
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Fibrosis is an inevitable stage in the development of chronic liver disease and has an irreplaceable role in characterizing the degree of progression of chronic liver disease. Histopathological diagnosis is the gold standard for the interpretation of fibrosis parameters. Conventional hematoxylin-eosin (H&E) staining can only reflect the gross structure of the tissue and the distribution of hepatocytes, while Masson trichrome can highlight specific types of collagen fiber structure, thus providing the necessary structural information for fibrosis scoring. However, the expensive costs of time, economy, and patient specimens as well as the non-uniform preparation and staining process make the conversion of existing H&E staining into virtual Masson trichrome staining a solution for fibrosis evaluation. Existing translation approaches fail to extract fiber features accurately enough, and the decoder of staining is unable to converge due to the inconsistent color of physical staining. In this work, we propose a prior-guided generative adversarial network, based on unpaired data for effective Masson trichrome stained image generation from the corresponding H&E stained image. Conducted on a small training set, our method takes full advantage of prior knowledge to set up better constraints on both the encoder and the decoder. Experiments indicate the superior performance of our method that surpasses the previous approaches. For various liver diseases, our results demonstrate a high correlation between the staging of real and virtual stains (p = 0.82; 95% CI: 0.73-0.89). In addition, our finetuning strategy is able to standardize the staining color and release the memory and computational burden, which can be employed in clinical assessment.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Unpaired Bone Marrow Smears Virtual Staining Using Content and Attention-Guided Generative Adversarial Networks UBMSVStain Using Content and Attention-Guided Generative Adversarial Networks
    Wang, Aman
    Zhu, Ruijie
    PROCEEDINGS OF 2023 4TH INTERNATIONAL SYMPOSIUM ON ARTIFICIAL INTELLIGENCE FOR MEDICINE SCIENCE, ISAIMS 2023, 2023, : 676 - 681
  • [2] Prior-guided generative adversarial network for mammogram synthesis
    Joseph, Annie Julie
    Dwivedi, Priyansh
    Joseph, Jiffy
    Francis, Seenia
    Pournami, P. N.
    Jayaraj, P. B.
    Shamsu, Ashna V.
    Sankaran, Praveen
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 87
  • [3] HoechstGAN: Virtual Lymphocyte Staining Using Generative Adversarial Networks
    Wolflein, Georg
    Um, In Hwa
    Harrison, David J.
    Arandjelovic, Ognjen
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 4986 - 4996
  • [4] Prior-Guided Image Reconstruction for Accelerated Multi-Contrast MRI via Generative Adversarial Networks
    Dar, Salman U. H.
    Yurt, Mahmut
    Shahdloo, Mohammad
    Ildiz, Muhammed Emrullah
    Tinaz, Berk
    Cukur, Tolga
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2020, 14 (06) : 1072 - 1087
  • [5] A Prior-Guided Generative Adversarial Net for Semantically Strict Ultrasound Images Augmentation
    Yu, Ruiguo
    Sun, Pan
    Li, Xuewei
    Zhang, Ruixuan
    Liu, Zhiqiang
    Gao, Jie
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, ICIC 2023, PT III, 2023, 14088 : 16 - 27
  • [6] Wound Histology Through Virtual Staining Using Generative Adversarial Networks
    Nidhi, Malavika
    Jones, Jake
    Woessner, Alan
    Quinn, Kyle
    WOUND REPAIR AND REGENERATION, 2024, 32 (04) : 543 - 544
  • [7] Prior-Guided Adversarial Initialization for Fast Adversarial Training
    Jia, Xiaojun
    Zhang, Yong
    Wei, Xingxing
    Wu, Baoyuan
    Ma, Ke
    Wang, Jue
    Cao, Xiaochun
    COMPUTER VISION - ECCV 2022, PT IV, 2022, 13664 : 567 - 584
  • [8] A Computationally Virtual Histological Staining Method to Ovarian Cancer Tissue by Deep Generative Adversarial Networks
    Meng, Xiangyu
    Li, Xin
    Wang, Xun
    COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2021, 2021
  • [9] Prior-guided adaptive generative adversarial network method for various types of borehole image inpainting
    Zhong, Zhaoyan
    Wang, Xin
    GEOPHYSICS, 2024, 89 (04) : D229 - D242
  • [10] AttentionGAN: Unpaired Image-to-Image Translation Using Attention-Guided Generative Adversarial Networks
    Tang, Hao
    Liu, Hong
    Xu, Dan
    Torr, Philip H. S.
    Sebe, Nicu
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (04) : 1972 - 1987