A Federated Learning System for Histopathology Image Analysis With an Orchestral Stain-Normalization GAN

被引:13
作者
Shen, Yiqing [1 ]
Sowmya, Arcot [2 ]
Luo, Yulin [3 ]
Liang, Xiaoyao [3 ]
Shen, Dinggang [4 ,5 ,6 ]
Ke, Jing [2 ,3 ]
机构
[1] Shanghai Jiao Tong Univ, Sch Math Sci, Shanghai 200240, Peoples R China
[2] Univ New South Wales, Sch Comp Sci & Engn, Sydney, NSW 2052, Australia
[3] Shanghai Jiao Tong Univ, Sch Elect Informat & Elect Engn, Shanghai 200240, Peoples R China
[4] ShanghaiTech Univ, Sch Biomed Engn, Shanghai 201210, Peoples R China
[5] ShanghaiUnited Imaging Intelligence Co Ltd, Shanghai 200230, Peoples R China
[6] Shanghai Clin Res & Trial Ctr, Shanghai 201210, Peoples R China
基金
美国国家卫生研究院;
关键词
Histopathology; federated learning; generative adversarial network; stain normalization; COLOR NORMALIZATION;
D O I
10.1109/TMI.2022.3221724
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Currently, data-driven based machine learning is considered one of the best choices in clinical pathology analysis, and its success is subject to the sufficiency of digitized slides, particularly those with deep annotations. Although centralized training on a large data set may be more reliable and more generalized, the slides to the examination are more often than not collected from many distributed medical institutes. This brings its own challenges, and the most important is the assurance of privacy and security of incoming data samples. In the discipline of histopathology image, the universal stain-variation issue adds to the difficulty of an automatic system as different clinical institutions provide distinct stain styles. To address these two important challenges in AI-based histopathology diagnoses, this work proposes a novel conditional Generative Adversarial Network (GAN) with one orchestration generator and multiple distributed discriminators, to cope with multiple-client based stain-style normalization. Implemented within a Federated Learning (FL) paradigm, this framework well preserves data privacy and security. Additionally, the training consistency and stability of the distributed system are further enhanced by a novel temporal self-distillation regularization scheme. Empirically, on large cohorts of histopathology datasets as a benchmark, the proposed model matches the performance of conventional centralized learning very closely. It also outperforms state-of-the-art stain-style transfer methods on the downstream Federated Learning image classification task, with an accuracy increase of over 20.0% in comparison to the baseline classification model.
引用
收藏
页码:1969 / 1981
页数:13
相关论文
共 59 条
  • [1] Siloed Federated Learning for Multi-centric Histopathology Datasets
    Andreux, Mathieu
    du Terrail, Jean Ogier
    Beguier, Constance
    Tramel, Eric W.
    [J]. DOMAIN ADAPTATION AND REPRESENTATION TRANSFER, AND DISTRIBUTED AND COLLABORATIVE LEARNING, DART 2020, DCL 2020, 2020, 12444 : 129 - 139
  • [2] A High-Performance System for Robust Stain Normalization of Whole-Slide Images in Histopathology
    Anghel, Andreea
    Stanisavljevic, Milos
    Andani, Sonali
    Papandreou, Nikolaos
    Rueschoff, Jan Hendrick
    Wild, Peter
    Gabrani, Maria
    Pozidis, Haralampos
    [J]. FRONTIERS IN MEDICINE, 2019, 6
  • [3] From Detection of Individual Metastases to Classification of Lymph Node Status at the Patient Level: The CAMELYON17 Challenge
    Bandi, Peter
    Geessink, Oscar
    Manson, Quirine
    van Dijk, Marcory
    Balkenhol, Maschenka
    Hermsen, Meyke
    Bejnordi, Babak Ehteshami
    Lee, Byungjae
    Paeng, Kyunghyun
    Zhong, Aoxiao
    Li, Quanzheng
    Zanjani, Farhad Ghazvinian
    Zinger, Svitlana
    Fukuta, Keisuke
    Komura, Daisuke
    Ovtcharov, Vlado
    Cheng, Shenghua
    Zeng, Shaoqun
    Thagaard, Jeppe
    Dahl, Anders B.
    Lin, Huangjing
    Chen, Hao
    Jacobsson, Ludwig
    Hedlund, Martin
    Cetin, Melih
    Halici, Eren
    Jackson, Hunter
    Chen, Richard
    Both, Fabian
    Franke, Joerg
    Kusters-Vandevelde, Heidi
    Vreuls, Willem
    Bult, Peter
    van Ginneken, Bram
    van der Laak, Jeroen
    Litjens, Geert
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (02) : 550 - 560
  • [4] Stain Specific Standardization of Whole-Slide Histopathological Images
    Bejnordi, Babak Ehteshami
    Litjens, Geert
    Timofeeva, Nadya
    Otte-Holler, Irene
    Homeyer, Andre
    Karssemeijer, Nico
    van der Laak, Jeroen A. W. M.
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2016, 35 (02) : 404 - 415
  • [5] Distributed deep learning networks among institutions for medical imaging
    Chang, Ken
    Balachandar, Niranjan
    Lam, Carson
    Yi, Darvin
    Brown, James
    Beers, Andrew
    Rosen, Bruce
    Rubin, Daniel L.
    Kalpathy-Cramer, Jayashree
    [J]. JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION, 2018, 25 (08) : 945 - 954
  • [6] Self-Supervised GANs via Auxiliary Rotation Loss
    Chen, Ting
    Zhai, Xiaohua
    Ritter, Marvin
    Lucic, Mario
    Houlsby, Neil
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 12146 - 12155
  • [7] Chenyou Fan, 2020, Pattern Recognition and Computer Vision. Third Chinese Conference, PRCV 2020. Proceedings. Lecture Notes in Computer Science (LNCS 12307), P3, DOI 10.1007/978-3-030-60636-7_1
  • [8] Cho HYJ, 2017, Arxiv, DOI [arXiv:1710.08543, 10.48550/arXiv.1710.08543]
  • [9] Ciompi F, 2017, I S BIOMED IMAGING, P160, DOI 10.1109/ISBI.2017.7950492
  • [10] Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning
    Coudray, Nicolas
    Ocampo, Paolo Santiago
    Sakellaropoulos, Theodore
    Narula, Navneet
    Snuderl, Matija
    Fenyo, David
    Moreira, Andre L.
    Razavian, Narges
    Tsirigos, Aristotelis
    [J]. NATURE MEDICINE, 2018, 24 (10) : 1559 - +