DeepBatch: A hybrid deep learning model for interpretable diagnosis of breast cancer in whole-slide images

被引:21
作者
Zeiser, Felipe Andre [1 ]
da Costa, Cristiano Andre [1 ]
Ramos, Gabriel de Oliveira [1 ]
Bohn, Henrique C. [1 ]
Santos, Ismael [1 ]
Roehe, Adriana Vial [2 ]
机构
[1] Univ Vale Rio dos Sinos, Software Innovat Lab SOFTWARELAB, Grad Program Appl Comp, Sao Leopoldo, Brazil
[2] Univ Fed Ciencias Saude Porto Alegre, Dept Patol & Med Legal, Porto Alegre, RS, Brazil
关键词
Deep learning; Whole-slide image; Convolutional neural network; Interpretable diagnosis; Breast cancer; Histopathological images; CLASSIFICATION;
D O I
10.1016/j.eswa.2021.115586
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The gold standard for breast cancer diagnosis, treatment, and management is the histological analysis of a suspected section. Histopathology consists in analyzing the characteristics of the lesions using tissue sections stained with hematoxylin and eosin. However, pathologists are currently subjected to high workloads, mainly due to the fundamental role of histological analysis in the patient's treatment. In this context, methods able to reduce histological analysis time, provide a second opinion, or even point out suspicious locations as a screening tool become increasingly important for pathologists. This article proposes a model based on Convolutional Neural Networks (CNN) to provide a refined and multiclass segmentation of Whole Slide Imaging (WSI) for breast cancer. The methodology is divided into four modules: pre-processing, ROI detection, ROI sampling, and region segmentation. These modules are organized to decode the information learned using CNNs in interpretable predictions for pathologists. The preprocessing module is responsible for removing background and noise from WSI. At ROI detection, we use the U-Net convolutional architecture to identify suspicious regions in low magnification WSI. The sampling module maps the identified suspected areas from low magnifications to 40x magnifications. region segmentation module segments high-magnification areas using a ResNet50/U-Net. To validate the methodology, we use data sets from different sources that can be used together or separately in each module, depending on its purpose. We used 205 breast cancer WSI for training, validation, and testing. For the detection of suspicious regions by ROI detection, we obtained an IoU of 93.43%, accuracy of 91.27%, sensitivity of 90.77%, specificity of 94.03%, F1 score of 84.17%, and an AUC of 0.93. For the refined segmentation of WSI by the region segmentation module, we obtained an IoU of 88.23%, accuracy of 96.10%, sensitivity of 71.83%, specificity of 96.19%, F1 score of 82.94%, and an AUC of 0.88. In short, the model provides refined segmentation of breast cancer WSIs using a cascade of CNNs. This segmentation can assist pathologists in interpreting the diagnosis by accurately presenting the regions considered during the inference of WSI. Our results indicate the possibility of using the model as a second screening system.
引用
收藏
页数:16
相关论文
共 38 条
  • [1] American Cancer Society, 2021, COMM IS BREAST CANC
  • [2] BACH: Grand challenge on breast cancer histology images
    Aresta, Guilherme
    Araujo, Teresa
    Kwok, Scotty
    Chennamsetty, Sai Saketh
    Safwan, Mohammed
    Alex, Varghese
    Marami, Bahram
    Prastawa, Marcel
    Chan, Monica
    Donovan, Michael
    Fernandez, Gerardo
    Zeineh, Jack
    Kohl, Matthias
    Walz, Christoph
    Ludwig, Florian
    Braunewell, Stefan
    Baust, Maximilian
    Quoc Dang Vu
    Minh Nguyen Nhat To
    Kim, Eal
    Kwak, Jin Tae
    Galal, Sameh
    Sanchez-Freire, Veronica
    Brancati, Nadia
    Frucci, Maria
    Riccio, Daniel
    Wang, Yaqi
    Sun, Lingling
    Ma, Kaiqiang
    Fang, Jiannan
    Kone, Ismael
    Boulmane, Lahsen
    Campilho, Aurelio
    Eloy, Catarina
    Polonia, Antonio
    Aguiar, Paulo
    [J]. MEDICAL IMAGE ANALYSIS, 2019, 56 : 122 - 139
  • [3] Baker QB, 2018, I C COMP SYST APPLIC
  • [4] Bejnordi BE, 2017, J MED IMAGING, V4, DOI 10.1117/1.JMI.4.4.044504
  • [5] BreakHis based breast cancer automatic diagnosis using deep learning: Taxonomy, survey and insights
    Benhammou, Yassir
    Achchab, Boujemaa
    Herrera, Francisco
    Tabik, Siham
    [J]. NEUROCOMPUTING, 2020, 375 : 9 - 24
  • [6] The Wonderful Colors of the Hematoxylin-Eosin Stain in Diagnostic Surgical Pathology
    Chan, John K. C.
    [J]. INTERNATIONAL JOURNAL OF SURGICAL PATHOLOGY, 2014, 22 (01) : 12 - 32
  • [7] Cochran WilliamGemmell., 1999, Sampling techniques, V3d
  • [8] High-throughput adaptive sampling for whole-slide histopathology image analysis (HASHI) via convolutional neural networks: Application to invasive breast cancer detection
    Cruz-Roa, Angel
    Gilmore, Hannah
    Basavanhally, Ajay
    Feldman, Michael
    Ganesan, Shridar
    Shih, Natalie
    Tomaszewski, John
    Madabhushi, Anant
    Gonzalez, Fabio
    [J]. PLOS ONE, 2018, 13 (05):
  • [9] Survey of deep learning in breast cancer image analysis
    Debelee, Taye Girma
    Schwenker, Friedhelm
    Ibenthal, Achim
    Yohannes, Dereje
    [J]. EVOLVING SYSTEMS, 2020, 11 (01) : 143 - 163
  • [10] Is mass classification in mammograms a solved problem? - A critical review over the last 20 years
    Dias Pedro, Ricardo Wandre
    Machado-Lima, Ariane
    Nunes, Fatima L. S.
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2019, 119 : 90 - 103