DeepBatch: A hybrid deep learning model for interpretable diagnosis of breast cancer in whole-slide images

被引:21
|
作者
Zeiser, Felipe Andre [1 ]
da Costa, Cristiano Andre [1 ]
Ramos, Gabriel de Oliveira [1 ]
Bohn, Henrique C. [1 ]
Santos, Ismael [1 ]
Roehe, Adriana Vial [2 ]
机构
[1] Univ Vale Rio dos Sinos, Software Innovat Lab SOFTWARELAB, Grad Program Appl Comp, Sao Leopoldo, Brazil
[2] Univ Fed Ciencias Saude Porto Alegre, Dept Patol & Med Legal, Porto Alegre, RS, Brazil
关键词
Deep learning; Whole-slide image; Convolutional neural network; Interpretable diagnosis; Breast cancer; Histopathological images; CLASSIFICATION;
D O I
10.1016/j.eswa.2021.115586
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The gold standard for breast cancer diagnosis, treatment, and management is the histological analysis of a suspected section. Histopathology consists in analyzing the characteristics of the lesions using tissue sections stained with hematoxylin and eosin. However, pathologists are currently subjected to high workloads, mainly due to the fundamental role of histological analysis in the patient's treatment. In this context, methods able to reduce histological analysis time, provide a second opinion, or even point out suspicious locations as a screening tool become increasingly important for pathologists. This article proposes a model based on Convolutional Neural Networks (CNN) to provide a refined and multiclass segmentation of Whole Slide Imaging (WSI) for breast cancer. The methodology is divided into four modules: pre-processing, ROI detection, ROI sampling, and region segmentation. These modules are organized to decode the information learned using CNNs in interpretable predictions for pathologists. The preprocessing module is responsible for removing background and noise from WSI. At ROI detection, we use the U-Net convolutional architecture to identify suspicious regions in low magnification WSI. The sampling module maps the identified suspected areas from low magnifications to 40x magnifications. region segmentation module segments high-magnification areas using a ResNet50/U-Net. To validate the methodology, we use data sets from different sources that can be used together or separately in each module, depending on its purpose. We used 205 breast cancer WSI for training, validation, and testing. For the detection of suspicious regions by ROI detection, we obtained an IoU of 93.43%, accuracy of 91.27%, sensitivity of 90.77%, specificity of 94.03%, F1 score of 84.17%, and an AUC of 0.93. For the refined segmentation of WSI by the region segmentation module, we obtained an IoU of 88.23%, accuracy of 96.10%, sensitivity of 71.83%, specificity of 96.19%, F1 score of 82.94%, and an AUC of 0.88. In short, the model provides refined segmentation of breast cancer WSIs using a cascade of CNNs. This segmentation can assist pathologists in interpreting the diagnosis by accurately presenting the regions considered during the inference of WSI. Our results indicate the possibility of using the model as a second screening system.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Pathologist-level interpretable whole-slide cancer diagnosis with deep learning
    Zhang, Zizhao
    Chen, Pingjun
    McGough, Mason
    Xing, Fuyong
    Wang, Chunbao
    Bui, Marilyn
    Xie, Yuanpu
    Sapkota, Manish
    Cui, Lei
    Dhillon, Jasreman
    Ahmad, Nazeel
    Khalil, Farah K.
    Dickinson, Shohreh I.
    Shi, Xiaoshuang
    Liu, Fujun
    Su, Hai
    Cai, Jinzheng
    Yang, Lin
    NATURE MACHINE INTELLIGENCE, 2019, 1 (05) : 236 - +
  • [2] Pathologist-level interpretable whole-slide cancer diagnosis with deep learning
    Zizhao Zhang
    Pingjun Chen
    Mason McGough
    Fuyong Xing
    Chunbao Wang
    Marilyn Bui
    Yuanpu Xie
    Manish Sapkota
    Lei Cui
    Jasreman Dhillon
    Nazeel Ahmad
    Farah K. Khalil
    Shohreh I. Dickinson
    Xiaoshuang Shi
    Fujun Liu
    Hai Su
    Jinzheng Cai
    Lin Yang
    Nature Machine Intelligence, 2019, 1 : 236 - 245
  • [3] Deep Learning Assisted Diagnosis of Onychomycosis on Whole-Slide Images
    Jansen, Philipp
    Creosteanu, Adelaida
    Matyas, Viktor
    Dilling, Amrei
    Pina, Ana
    Saggini, Andrea
    Schimming, Tobias
    Landsberg, Jennifer
    Burgdorf, Birte
    Giaquinta, Sylvia
    Mueller, Hansgeorg
    Emberger, Michael
    Rose, Christian
    Schmitz, Lutz
    Geraud, Cyrill
    Schadendorf, Dirk
    Schaller, Joerg
    Alber, Maximilian
    Klauschen, Frederick
    Griewank, Klaus G.
    JOURNAL OF FUNGI, 2022, 8 (09)
  • [4] Publisher Correction: Pathologist-level interpretable whole-slide cancer diagnosis with deep learning
    Zizhao Zhang
    Pingjun Chen
    Mason McGough
    Fuyong Xing
    Chunbao Wang
    Marilyn Bui
    Yuanpu Xie
    Manish Sapkota
    Lei Cui
    Jasreman Dhillon
    Nazeel Ahmad
    Farah K. Khalil
    Shohreh I. Dickinson
    Xiaoshuang Shi
    Fujun Liu
    Hai Su
    Jinzheng Cai
    Lin Yang
    Nature Machine Intelligence, 2019, 1 : 384 - 384
  • [5] Publisher Correction: Pathologist-level interpretable whole-slide cancer diagnosis with deep learning
    Zizhao Zhang
    Pingjun Chen
    Mason McGough
    Fuyong Xing
    Chunbao Wang
    Marilyn Bui
    Yuanpu Xie
    Manish Sapkota
    Lei Cui
    Jasreman Dhillon
    Nazeel Ahmad
    Farah K. Khalil
    Shohreh I. Dickinson
    Xiaoshuang Shi
    Fujun Liu
    Hai Su
    Jinzheng Cai
    Lin Yang
    Nature Machine Intelligence, 2019, 1 : 289 - 289
  • [6] Accurate diagnosis of lymphoma on whole-slide histopathology images using deep learning
    Syrykh, Charlotte
    Abreu, Arnaud
    Amara, Nadia
    Siegfried, Aurore
    Maisongrosse, Veronique
    Frenois, Francois X.
    Martin, Laurent
    Rossi, Cedric
    Laurent, Camille
    Brousset, Pierre
    NPJ DIGITAL MEDICINE, 2020, 3 (01)
  • [7] Accurate diagnosis of lymphoma on whole-slide histopathology images using deep learning
    Charlotte Syrykh
    Arnaud Abreu
    Nadia Amara
    Aurore Siegfried
    Véronique Maisongrosse
    François X. Frenois
    Laurent Martin
    Cédric Rossi
    Camille Laurent
    Pierre Brousset
    npj Digital Medicine, 3
  • [8] Pathologist-level interpretable whole-slide cancer diagnosis with deep learning (vol 1, 236, 2019)
    Zhang, Zizhao
    Chen, Pingjun
    McGough, Mason
    Xing, Fuyong
    Wang, Chunbao
    Bui, Marilyn
    Xie, Yuanpu
    Sapkota, Manish
    Cui, Lei
    Dhillon, Jasreman
    Ahmad, Nazeel
    Khalil, Farah K.
    Dickinson, Shohreh I.
    Shi, Xiaoshuang
    Liu, Fujun
    Su, Hai
    Cai, Jinzheng
    Yang, Lin
    NATURE MACHINE INTELLIGENCE, 2019, 1 (06) : 289 - 289
  • [9] Multiclass Classification of Breast Cancer in Whole-Slide Images
    Kwok, Scotty
    IMAGE ANALYSIS AND RECOGNITION (ICIAR 2018), 2018, 10882 : 931 - 940
  • [10] Deep learning-based breast cancer grading and survival analysis on whole-slide histopathology images
    Suzanne C. Wetstein
    Vincent M. T. de Jong
    Nikolas Stathonikos
    Mark Opdam
    Gwen M. H. E. Dackus
    Josien P. W. Pluim
    Paul J. van Diest
    Mitko Veta
    Scientific Reports, 12