A Federated Learning System for Histopathology Image Analysis With an Orchestral Stain-Normalization GAN

被引:13
作者
Shen, Yiqing [1 ]
Sowmya, Arcot [2 ]
Luo, Yulin [3 ]
Liang, Xiaoyao [3 ]
Shen, Dinggang [4 ,5 ,6 ]
Ke, Jing [2 ,3 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Math Sci, Shanghai 200240, Peoples R China
[2] Univ New South Wales, Sch Comp Sci & Engn, Sydney, NSW 2052, Australia
[3] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai 200240, Peoples R China
[4] ShanghaiTech Univ, Sch Biomed Engn, Shanghai 201210, Peoples R China
[5] ShanghaiUnited Imaging Intelligence Co Ltd, Shanghai 200230, Peoples R China
[6] Shanghai Clin Res & Trial Ctr, Shanghai 201210, Peoples R China
基金
美国国家卫生研究院;
关键词
Histopathology; federated learning; generative adversarial network; stain normalization; COLOR NORMALIZATION;
D O I
10.1109/TMI.2022.3221724
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Currently, data-driven based machine learning is considered one of the best choices in clinical pathology analysis, and its success is subject to the sufficiency of digitized slides, particularly those with deep annotations. Although centralized training on a large data set may be more reliable and more generalized, the slides to the examination are more often than not collected from many distributed medical institutes. This brings its own challenges, and the most important is the assurance of privacy and security of incoming data samples. In the discipline of histopathology image, the universal stain-variation issue adds to the difficulty of an automatic system as different clinical institutions provide distinct stain styles. To address these two important challenges in AI-based histopathology diagnoses, this work proposes a novel conditional Generative Adversarial Network (GAN) with one orchestration generator and multiple distributed discriminators, to cope with multiple-client based stain-style normalization. Implemented within a Federated Learning (FL) paradigm, this framework well preserves data privacy and security. Additionally, the training consistency and stability of the distributed system are further enhanced by a novel temporal self-distillation regularization scheme. Empirically, on large cohorts of histopathology datasets as a benchmark, the proposed model matches the performance of conventional centralized learning very closely. It also outperforms state-of-the-art stain-style transfer methods on the downstream Federated Learning image classification task, with an accuracy increase of over 20.0% in comparison to the baseline classification model.
引用
收藏
页码:1969 / 1981
页数:13
相关论文
共 59 条
  • [21] Stain Normalization using Sparse AutoEncoders (StalloSA): Application to digital pathology
    Janowczyk, Andrew
    Basavanhally, Ajay
    Madabhushi, Anant
    [J]. COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2017, 57 : 50 - 61
  • [22] Jing Ke, 2020, ICBET 2020: Proceedings of the 2020 10th International Conference on Biomedical Engineering and Technology, P334, DOI 10.1145/3397391.3397442
  • [23] Kairouz P., 2019, arXiv
  • [24] Predicting survival from colorectal cancer histology slides using deep learning: A retrospective multicenter study
    Kather, Jakob Nikolas
    Krisam, Johannes
    Charoentong, Pornpimol
    Luedde, Tom
    Herpel, Esther
    Weis, Cleo-Aron
    Gaiser, Timo
    Marx, Alexander
    Valous, Nektarios A.
    Ferber, Dyke
    Jansen, Lina
    Reyes-Aldasoro, Constantino Carlos
    Zoernig, Inka
    Jaeger, Dirk
    Brenner, Hermann
    Chang-Claude, Jenny
    Hoffmeister, Michael
    Halama, Niels
    [J]. PLOS MEDICINE, 2019, 16 (01)
  • [25] Contrastive Learning Based Stain Normalization Across Multiple Tumor in Histopathology
    Ke, Jing
    Shen, Yiqing
    Liang, Xiaoyao
    Shen, Dinggang
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VIII, 2021, 12908 : 571 - 580
  • [26] STYLE NORMALIZATION IN HISTOLOGY WITH FEDERATED LEARNING
    Ke, Jing
    Shen, Yiqing
    Lu, Yizhou
    [J]. 2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, : 953 - 956
  • [27] Multiple-datasets and Multiple-label based Color Normalization in Histopathology with cGAN
    Ke, Jing
    Shen, Yiqing
    Jiang, Xinyu
    Guo, Yi
    Chen, Yaobing
    Liang, Xiaoyao
    [J]. MEDICAL IMAGING 2021 - DIGITAL PATHOLOGY, 2021, 11603
  • [28] A Nonlinear Mapping Approach to Stain Normalization in Digital Histopathology Images Using Image-Specific Color Deconvolution
    Khan, Adnan Mujahid
    Rajpoot, Nasir
    Treanor, Darren
    Magee, Derek
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2014, 61 (06) : 1729 - 1738
  • [29] Privacy-Preserving Federated Brain Tumour Segmentation
    Li, Wenqi
    Milletari, Fausto
    Xu, Daguang
    Rieke, Nicola
    Hancox, Jonny
    Zhu, Wentao
    Baust, Maximilian
    Cheng, Yan
    Ourselin, Sebastien
    Cardoso, M. Jorge
    Feng, Andrew
    [J]. MACHINE LEARNING IN MEDICAL IMAGING (MLMI 2019), 2019, 11861 : 133 - 141
  • [30] Li X., 2020, PROC INT C LEARN REP, P1