DeepBatch: A hybrid deep learning model for interpretable diagnosis of breast cancer in whole-slide images

被引:21
|
作者
Zeiser, Felipe Andre [1 ]
da Costa, Cristiano Andre [1 ]
Ramos, Gabriel de Oliveira [1 ]
Bohn, Henrique C. [1 ]
Santos, Ismael [1 ]
Roehe, Adriana Vial [2 ]
机构
[1] Univ Vale Rio dos Sinos, Software Innovat Lab SOFTWARELAB, Grad Program Appl Comp, Sao Leopoldo, Brazil
[2] Univ Fed Ciencias Saude Porto Alegre, Dept Patol & Med Legal, Porto Alegre, RS, Brazil
关键词
Deep learning; Whole-slide image; Convolutional neural network; Interpretable diagnosis; Breast cancer; Histopathological images; CLASSIFICATION;
D O I
10.1016/j.eswa.2021.115586
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The gold standard for breast cancer diagnosis, treatment, and management is the histological analysis of a suspected section. Histopathology consists in analyzing the characteristics of the lesions using tissue sections stained with hematoxylin and eosin. However, pathologists are currently subjected to high workloads, mainly due to the fundamental role of histological analysis in the patient's treatment. In this context, methods able to reduce histological analysis time, provide a second opinion, or even point out suspicious locations as a screening tool become increasingly important for pathologists. This article proposes a model based on Convolutional Neural Networks (CNN) to provide a refined and multiclass segmentation of Whole Slide Imaging (WSI) for breast cancer. The methodology is divided into four modules: pre-processing, ROI detection, ROI sampling, and region segmentation. These modules are organized to decode the information learned using CNNs in interpretable predictions for pathologists. The preprocessing module is responsible for removing background and noise from WSI. At ROI detection, we use the U-Net convolutional architecture to identify suspicious regions in low magnification WSI. The sampling module maps the identified suspected areas from low magnifications to 40x magnifications. region segmentation module segments high-magnification areas using a ResNet50/U-Net. To validate the methodology, we use data sets from different sources that can be used together or separately in each module, depending on its purpose. We used 205 breast cancer WSI for training, validation, and testing. For the detection of suspicious regions by ROI detection, we obtained an IoU of 93.43%, accuracy of 91.27%, sensitivity of 90.77%, specificity of 94.03%, F1 score of 84.17%, and an AUC of 0.93. For the refined segmentation of WSI by the region segmentation module, we obtained an IoU of 88.23%, accuracy of 96.10%, sensitivity of 71.83%, specificity of 96.19%, F1 score of 82.94%, and an AUC of 0.88. In short, the model provides refined segmentation of breast cancer WSIs using a cascade of CNNs. This segmentation can assist pathologists in interpreting the diagnosis by accurately presenting the regions considered during the inference of WSI. Our results indicate the possibility of using the model as a second screening system.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Predicting oncogene mutations of lung cancer using deep learning and histopathologic features on whole-slide images
    Tomita, Naofumi
    Tafe, Laura J.
    Suriawinata, Arief A.
    Tsongalis, Gregory J.
    Nasir-Moin, Mustafa
    Dragnev, Konstantin
    Hassanpour, Saeed
    TRANSLATIONAL ONCOLOGY, 2022, 24
  • [42] Diagnosis of Alzheimer Disease and Tauopathies on Whole-Slide Histopathology Images Using a Weakly Supervised Deep Learning Algorithm
    Kim, Minji
    Sekiya, Hiroaki
    Yao, Gary
    Martin, Nicholas B.
    Castanedes-Casey, Monica
    Dickson, Dennis W.
    Hwang, Tae Hyun
    Koga, Shunsuke
    LABORATORY INVESTIGATION, 2023, 103 (06)
  • [43] Efficient and Highly Accurate Diagnosis of Malignant Hematological Diseases Based on Whole-Slide Images Using Deep Learning
    Wang, Chong
    Wei, Xiu-Li
    Li, Chen-Xi
    Wang, Yang-Zhen
    Wu, Yang
    Niu, Yan-Xiang
    Zhang, Chen
    Yu, Yi
    FRONTIERS IN ONCOLOGY, 2022, 12
  • [44] Learning how to detect: A deep reinforcement learning method for whole-slide melanoma histopathology images
    Zheng, Tingting
    Chen, Weixing
    Li, Shuqin
    Quan, Hao
    Zou, Mingchen
    Zheng, Song
    Zhao, Yue
    Gao, Xinghua
    Cui, Xiaoyu
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2023, 108
  • [45] Dual attention model with reinforcement learning for classification of histology whole-slide images
    Raza, Manahil
    Awan, Ruqayya
    Bashir, Raja Muhammad Saad
    Qaiser, Talha
    Rajpoot, Nasir M.
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2024, 118
  • [46] Diagnostic assessment of deep learning for melanocytic lesions using whole-slide pathological images
    Ba, Wei
    Wang, Rui
    Yin, Guang
    Song, Zhigang
    Zou, Jinyi
    Zhong, Cheng
    Yang, Jingrun
    Yu, Guanzhen
    Yang, Hongyu
    Zhang, Litao
    Li, Chengxin
    TRANSLATIONAL ONCOLOGY, 2021, 14 (09):
  • [47] Graph deep learning detects contextual prognostic biomarkers from whole-slide images
    Kwon, Sunghoon
    Park, Jeong Hwan
    NATURE BIOMEDICAL ENGINEERING, 2022, 6 (12) : 1326 - 1327
  • [48] Graph deep learning detects contextual prognostic biomarkers from whole-slide images
    Nature Biomedical Engineering, 2022, 6 : 1326 - 1327
  • [49] Deep Learning for Automatic Subclassification of Gastric Carcinoma Using Whole-Slide Histopathology Images
    Jang, Hyun-Jong
    Song, In-Hye
    Lee, Sung-Hak
    CANCERS, 2021, 13 (15)
  • [50] Deep learning system for lymph node quantification and metastatic cancer identification from whole-slide pathology images
    Hu, Yajie
    Su, Feng
    Dong, Kun
    Wang, Xinyu
    Zhao, Xinya
    Jiang, Yumeng
    Li, Jianming
    Ji, Jiafu
    Sun, Yu
    GASTRIC CANCER, 2021, 24 (04) : 868 - 877