High-throughput adaptive sampling for whole-slide histopathology image analysis (HASHI) via convolutional neural networks: Application to invasive breast cancer detection

被引:80
作者
Cruz-Roa, Angel [1 ,2 ]
Gilmore, Hannah [3 ]
Basavanhally, Ajay [4 ]
Feldman, Michael [5 ]
Ganesan, Shridar [6 ]
Shih, Natalie [5 ]
Tomaszewski, John [7 ]
Madabhushi, Anant [8 ]
Gonzalez, Fabio [2 ]
机构
[1] Univ Llanos, Sch Engn, Villavicencio, Meta, Colombia
[2] Univ Nacl Colombia, Dept Comp Syst & Ind Engn, Bogota, Cundinamarca, Colombia
[3] Univ Hosp Case Med Ctr, Cleveland, OH USA
[4] Inspirata Inc, Tampa, FL USA
[5] Hosp Univ Penn, Philadelphia, PA USA
[6] Canc Inst New Jersey, New Brunswick, NJ USA
[7] SUNY Buffalo, Univ Buffalo, Buffalo, NY USA
[8] Case Western Reserve Univ, Cleveland, OH 44106 USA
基金
美国国家卫生研究院;
关键词
INFORMATICS; FRAMEWORK; GRADE;
D O I
10.1371/journal.pone.0196828
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Precise detection of invasive cancer on whole-slide images (WSI) is a critical first step in digital pathology tasks of diagnosis and grading. Convolutional neural network (CNN) is the most popular representation learning method for computer vision tasks, which have been successfully applied in digital pathology, including tumor and mitosis detection. However, CNNs are typically only tenable with relatively small image sizes (200 x 200 pixels). Only recently, Fully convolutional networks (FCN) are able to deal with larger image sizes (500 x 500 pixels) for semantic segmentation. Hence, the direct application of CNNs to WSI is not computationally feasible because for a WSI, a CNN would require billions or trillions of parameters. To alleviate this issue, this paper presents a novel method, High-throughput Adaptive Sampling for whole-slide Histopathology Image analysis (HASHI), which involves: i) a new efficient adaptive sampling method based on probability gradient and quasi-Monte Carlo sampling, and, ii) a powerful representation learning classifier based on CNNs. We applied HASHI to automated detection of invasive breast cancer on WSI. HASHI was trained and validated using three different data cohorts involving near 500 cases and then independently tested on 195 studies from The Cancer Genome Atlas. The results show that (1) the adaptive sampling method is an effective strategy to deal with WSI without compromising prediction accuracy by obtaining comparative results of a dense sampling (similar to 6 million of samples in 24 hours) with far fewer samples (similar to 2,000 samples in 1 minute), and (2) on an independent test dataset, HASHI is effective and robust to data from multiple sites, scanners, and platforms, achieving an average Dice coefficient of 76%.
引用
收藏
页数:23
相关论文
共 63 条
[21]   HistoStitcher©: An interactive program for accurate and rapid reconstruction of digitized whole histological sections from tissue fragments [J].
Chappelow, Jonathan ;
Tomaszewski, John E. ;
Feldman, Michael ;
Shih, Natalie ;
Madabhushi, Anant .
COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2011, 35 (7-8) :557-567
[22]   DCAN: Deep Contour-Aware Networks for Accurate Gland Segmentation [J].
Chen, Hao ;
Qi, Xiaojuan ;
Yu, Lequan ;
Heng, Pheng-Ann .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2487-2496
[23]   Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks [J].
Ciresan, Dan C. ;
Giusti, Alessandro ;
Gambardella, Luca M. ;
Schmidhuber, Juergen .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI 2013, PT II, 2013, 8150 :411-418
[24]   Accurate and reproducible invasive breast cancer detection in whole-slide images: A Deep Learning approach for quantifying tumor extent [J].
Cruz-Roa, Angel ;
Gilmore, Hannah ;
Basavanhally, Ajay ;
Feldman, Michael ;
Ganesan, Shridar ;
Shih, Natalie N. C. ;
Tomaszewski, John ;
Gonzalez, Fabio A. ;
Madabhushi, Anant .
SCIENTIFIC REPORTS, 2017, 7
[25]   A method for Medulloblastoma Tumor Differentiation based on Convolutional Neural Networks and Transfer Learning [J].
Cruz-Roa, Angel ;
Arevalo, John ;
Judkins, Alexander ;
Madabhushi, Anant ;
Gonzalez, Fabio .
11TH INTERNATIONAL SYMPOSIUM ON MEDICAL INFORMATION PROCESSING AND ANALYSIS, 2015, 9681
[26]   Automatic detection of invasive ductal carcinoma in whole slide images with Convolutional Neural Networks [J].
Cruz-Roa, Angel ;
Basavanhally, Ajay ;
Gonzalez, Fabio ;
Gilmore, Hannah ;
Feldman, Michael ;
Ganesan, Shridar ;
Shih, Natalie ;
Tomaszewski, John ;
Madabhushi, Anant .
MEDICAL IMAGING 2014: DIGITAL PATHOLOGY, 2014, 9041
[27]  
Cruz-Roa Angel, 2011, J Pathol Inform, V2, pS4, DOI 10.4103/2153-3539.92031
[28]   Visual pattern mining in histology image collections using bag of features [J].
Cruz-Roa, Angel ;
Caicedo, Juan C. ;
Gonzalez, Fabio A. .
ARTIFICIAL INTELLIGENCE IN MEDICINE, 2011, 52 (02) :91-106
[29]   Standardizing the use of whole slide images in digital pathology [J].
Daniel, Christel ;
Garcia Rojo, Marcial ;
Klossa, Jacques ;
Della Mea, Vincenzo ;
Booker, David ;
Beckwith, Bruce A. ;
Schrader, Thomas .
COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2011, 35 (7-8) :496-505
[30]   MEASURES OF THE AMOUNT OF ECOLOGIC ASSOCIATION BETWEEN SPECIES [J].
DICE, LR .
ECOLOGY, 1945, 26 (03) :297-302