Deep Multi-Magnification Networks for multi-class breast cancer image segmentation

被引:79
作者
Ho, David Joon [1 ]
Yarlagadda, Dig V. K. [1 ]
D'Alfonso, Timothy M. [1 ]
Hanna, Matthew G. [1 ]
Grabenstetter, Anne [1 ]
Ntiamoah, Peter [1 ]
Brogi, Edi [1 ]
Tan, Lee K. [1 ]
Fuchs, Thomas J. [1 ,2 ]
机构
[1] Mem Sloan Kettering Canc Ctr, Dept Pathol, New York, NY 10065 USA
[2] Weill Cornell Grad Sch Med Sci, New York, NY 10065 USA
基金
美国国家卫生研究院;
关键词
Breast cancer; Computational pathology; Multi-class image segmentation; Deep Multi-Magnification Network; Partial annotation;
D O I
10.1016/j.compmedimag.2021.101866
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Pathologic analysis of surgical excision specimens for breast carcinoma is important to evaluate the completeness of surgical excision and has implications for future treatment. This analysis is performed manually by pathologists reviewing histologic slides prepared from formalin-fixed tissue. In this paper, we present Deep Multi-Magnification Network trained by partial annotation for automated multi-class tissue segmentation by a set of patches from multiple magnifications in digitized whole slide images. Our proposed architecture with multi-encoder, multi-decoder, and multi-concatenation outperforms other single and multi-magnification-based architectures by achieving the highest mean intersection-over-union, and can be used to facilitate pathologists' assessments of breast cancer.
引用
收藏
页数:15
相关论文
共 44 条
[1]  
Agarwalla A., 2017, ARXIV170708814
[2]   An Integrated Region-, Boundary-, Shape-Based Active Contour for Multiple Object Overlap Resolution in Histological Imagery [J].
Ali, Sahirzeeshan ;
Madabhushi, Anant .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2012, 31 (07) :1448-1460
[3]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[4]   From Detection of Individual Metastases to Classification of Lymph Node Status at the Patient Level: The CAMELYON17 Challenge [J].
Bandi, Peter ;
Geessink, Oscar ;
Manson, Quirine ;
van Dijk, Marcory ;
Balkenhol, Maschenka ;
Hermsen, Meyke ;
Bejnordi, Babak Ehteshami ;
Lee, Byungjae ;
Paeng, Kyunghyun ;
Zhong, Aoxiao ;
Li, Quanzheng ;
Zanjani, Farhad Ghazvinian ;
Zinger, Svitlana ;
Fukuta, Keisuke ;
Komura, Daisuke ;
Ovtcharov, Vlado ;
Cheng, Shenghua ;
Zeng, Shaoqun ;
Thagaard, Jeppe ;
Dahl, Anders B. ;
Lin, Huangjing ;
Chen, Hao ;
Jacobsson, Ludwig ;
Hedlund, Martin ;
Cetin, Melih ;
Halici, Eren ;
Jackson, Hunter ;
Chen, Richard ;
Both, Fabian ;
Franke, Joerg ;
Kusters-Vandevelde, Heidi ;
Vreuls, Willem ;
Bult, Peter ;
van Ginneken, Bram ;
van der Laak, Jeroen ;
Litjens, Geert .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (02) :550-560
[5]   Using deep convolutional neural networks to identify and classify tumor-associated stroma in diagnostic breast biopsies [J].
Bejnordi, Babak Ehteshami ;
Mullooly, Maeve ;
Pfeiffer, Ruth M. ;
Fan, Shaoqi ;
Vacek, Pamela M. ;
Weaver, Donald L. ;
Herschorn, Sally ;
Brinton, Louise A. ;
van Ginneken, Bram ;
Karssemeijer, Nico ;
Beck, Andrew H. ;
Gierach, Gretchen L. ;
van der Laak, Jeroen A. W. M. ;
Sherman, Mark E. .
MODERN PATHOLOGY, 2018, 31 (10) :1502-1512
[6]   Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer [J].
Bejnordi, Babak Ehteshami ;
Veta, Mitko ;
van Diest, Paul Johannes ;
van Ginneken, Bram ;
Karssemeijer, Nico ;
Litjens, Geert ;
van der Laak, Jeroen A. W. M. .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2017, 318 (22) :2199-2210
[7]  
Bokhorst JM, 2019, PR MACH LEARN RES, V102, P84
[8]  
Bray F, 2018, CA-CANCER J CLIN, V68, P394, DOI [10.3322/caac.21492, 10.3322/caac.21609]
[9]   A systematic study of the class imbalance problem in convolutional neural networks [J].
Buda, Mateusz ;
Maki, Atsuto ;
Mazurowski, Maciej A. .
NEURAL NETWORKS, 2018, 106 :249-259
[10]   Clinical-grade computational pathology using weakly supervised deep learning on whole slide images [J].
Campanella, Gabriele ;
Hanna, Matthew G. ;
Geneslaw, Luke ;
Miraflor, Allen ;
Silva, Vitor Werneck Krauss ;
Busam, Klaus J. ;
Brogi, Edi ;
Reuter, Victor E. ;
Klimstra, David S. ;
Fuchs, Thomas J. .
NATURE MEDICINE, 2019, 25 (08) :1301-+