DeepBatch: A hybrid deep learning model for interpretable diagnosis of breast cancer in whole-slide images

被引:21
|
作者
Zeiser, Felipe Andre [1 ]
da Costa, Cristiano Andre [1 ]
Ramos, Gabriel de Oliveira [1 ]
Bohn, Henrique C. [1 ]
Santos, Ismael [1 ]
Roehe, Adriana Vial [2 ]
机构
[1] Univ Vale Rio dos Sinos, Software Innovat Lab SOFTWARELAB, Grad Program Appl Comp, Sao Leopoldo, Brazil
[2] Univ Fed Ciencias Saude Porto Alegre, Dept Patol & Med Legal, Porto Alegre, RS, Brazil
关键词
Deep learning; Whole-slide image; Convolutional neural network; Interpretable diagnosis; Breast cancer; Histopathological images; CLASSIFICATION;
D O I
10.1016/j.eswa.2021.115586
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The gold standard for breast cancer diagnosis, treatment, and management is the histological analysis of a suspected section. Histopathology consists in analyzing the characteristics of the lesions using tissue sections stained with hematoxylin and eosin. However, pathologists are currently subjected to high workloads, mainly due to the fundamental role of histological analysis in the patient's treatment. In this context, methods able to reduce histological analysis time, provide a second opinion, or even point out suspicious locations as a screening tool become increasingly important for pathologists. This article proposes a model based on Convolutional Neural Networks (CNN) to provide a refined and multiclass segmentation of Whole Slide Imaging (WSI) for breast cancer. The methodology is divided into four modules: pre-processing, ROI detection, ROI sampling, and region segmentation. These modules are organized to decode the information learned using CNNs in interpretable predictions for pathologists. The preprocessing module is responsible for removing background and noise from WSI. At ROI detection, we use the U-Net convolutional architecture to identify suspicious regions in low magnification WSI. The sampling module maps the identified suspected areas from low magnifications to 40x magnifications. region segmentation module segments high-magnification areas using a ResNet50/U-Net. To validate the methodology, we use data sets from different sources that can be used together or separately in each module, depending on its purpose. We used 205 breast cancer WSI for training, validation, and testing. For the detection of suspicious regions by ROI detection, we obtained an IoU of 93.43%, accuracy of 91.27%, sensitivity of 90.77%, specificity of 94.03%, F1 score of 84.17%, and an AUC of 0.93. For the refined segmentation of WSI by the region segmentation module, we obtained an IoU of 88.23%, accuracy of 96.10%, sensitivity of 71.83%, specificity of 96.19%, F1 score of 82.94%, and an AUC of 0.88. In short, the model provides refined segmentation of breast cancer WSIs using a cascade of CNNs. This segmentation can assist pathologists in interpreting the diagnosis by accurately presenting the regions considered during the inference of WSI. Our results indicate the possibility of using the model as a second screening system.
引用
收藏
页数:16
相关论文
共 50 条
  • [31] A pyramidal deep learning pipeline for kidney whole-slide histology images classification
    Abdeltawab, Hisham
    Khalifa, Fahmi
    Mohammed, Mohammed
    Cheng, Liang
    Gondim, Dibson
    El-Baz, Ayman
    SCIENTIFIC REPORTS, 2021, 11 (01)
  • [32] RLogist: Fast Observation Strategy on Whole-Slide Images with Deep Reinforcement Learning
    Zhao, Boxuan
    Zhang, Jun
    Ye, Deheng
    Cao, Jian
    Han, Xiao
    Fu, Qiang
    Yang, Wei
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 3, 2023, : 3570 - 3578
  • [33] A pyramidal deep learning pipeline for kidney whole-slide histology images classification
    Hisham Abdeltawab
    Fahmi Khalifa
    Mohammed Ghazal
    Liang Cheng
    Dibson Gondim
    Ayman El-Baz
    Scientific Reports, 11
  • [34] Deep learning for bone marrow cell detection and classification on whole-slide images
    Wang, Ching-Wei
    Huang, Sheng-Chuan
    Lee, Yu-Ching
    Shen, Yu-Jie
    Meng, Shwu-Ing
    Gaol, Jeff L.
    Medical Image Analysis, 2022, 75
  • [35] Deep Learning for Skin Melanocytic Tumors in Whole-Slide Images: A Systematic Review
    Mosquera-Zamudio, Andres
    Launet, Laetitia
    Tabatabaei, Zahra
    Parra-Medina, Rafael
    Colomer, Adrian
    Oliver Moll, Javier
    Monteagudo, Carlos
    Janssen, Emiel
    Naranjo, Valery
    CANCERS, 2023, 15 (01)
  • [36] Deep learning for bone marrow cell detection and classification on whole-slide images
    Wang, Ching-Wei
    Huang, Sheng-Chuan
    Lee, Yu-Ching
    Shen, Yu-Jie
    Meng, Shwu-Ing
    Gaol, Jeff L.
    MEDICAL IMAGE ANALYSIS, 2022, 75
  • [37] Fast Segmentation of Metastatic Foci in H&E Whole-Slide Images for Breast Cancer Diagnosis
    Khalil, Muhammad-Adil
    Lee, Yu-Ching
    Lien, Huang-Chun
    Jeng, Yung-Ming
    Wang, Ching-Wei
    DIAGNOSTICS, 2022, 12 (04)
  • [38] A Deep Learning Model for Prostate Adenocarcinoma Classification in Needle Biopsy Whole-Slide Images Using Transfer Learning
    Tsuneki, Masayuki
    Abe, Makoto
    Kanavati, Fahdi
    DIAGNOSTICS, 2022, 12 (03)
  • [39] Interpretable deep learning model to predict lymph node metastasis in early gastric cancer using whole slide images
    Sung, You-Na
    Lee, Hyeseong
    Kim, Eunsu
    Jung, Woon Yong
    Sohn, Jin-Hee
    Lee, Yoo Jin
    Keum, Bora
    Ahn, Sangjeong
    Lee, Sung Hak
    AMERICAN JOURNAL OF CANCER RESEARCH, 2024, 14 (07):
  • [40] The Immune Subtypes and Landscape of Gastric Cancer and to Predict Based on the Whole-Slide Images Using Deep Learning
    Chen, Yan
    Sun, Zepang
    Chen, Wanlan
    Liu, Changyan
    Chai, Ruoyang
    Ding, Jingjing
    Liu, Wen
    Feng, Xianzhen
    Zhou, Jun
    Shen, Xiaoyi
    Huang, Shan
    Xu, Zhongqing
    FRONTIERS IN IMMUNOLOGY, 2021, 12