Recent Advances of Deep Learning for Computational Histopathology: Principles and Applications

被引:60
作者
Wu, Yawen [1 ]
Cheng, Michael [2 ,3 ]
Huang, Shuo [1 ]
Pei, Zongxiang [1 ]
Zuo, Yingli [1 ]
Liu, Jianxin [1 ]
Yang, Kai [1 ]
Zhu, Qi [1 ]
Zhang, Jie [2 ,3 ]
Hong, Honghai [4 ]
Zhang, Daoqiang [1 ]
Huang, Kun [2 ,3 ]
Cheng, Liang [5 ,6 ]
Shao, Wei [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Comp Sci & Technol, MIIT Key Lab Pattern Anal & Machine Intelligence, Nanjing 211106, Peoples R China
[2] Indiana Univ Sch Med, Dept Med, Indianapolis, IN 46202 USA
[3] Indiana Univ, Regenstrief Inst, Indianapolis, IN 46202 USA
[4] Guangzhou Med Univ, Dept Clin Lab, Affiliated Hosp 3, Guangzhou 510006, Peoples R China
[5] Indiana Univ Sch Med, Dept Pathol, Indianapolis, IN 46202 USA
[6] Indiana Univ Sch Med, Dept Lab Med, Indianapolis, IN 46202 USA
基金
美国国家科学基金会;
关键词
artificial intelligence; machine learning; digital pathology image analysis; color normalization; segmentation; diagnosis and prognosis; a whole-slide pathological imaging (WSI); BREAST-CANCER; ARTIFICIAL-INTELLIGENCE; INSTANCE SEGMENTATION; GLAND SEGMENTATION; CELL DETECTION; IMAGES; NORMALIZATION; PREDICTION; EFFICIENT; SURVIVAL;
D O I
10.3390/cancers14051199
中图分类号
R73 [肿瘤学];
学科分类号
100214 ;
摘要
With the remarkable success of digital histopathology, we have witnessed a rapid expansion of the use of computational methods for the analysis of digital pathology and biopsy image patches. However, the unprecedented scale and heterogeneous patterns of histopathological images have presented critical computational bottlenecks requiring new computational histopathology tools. Recently, deep learning technology has been extremely successful in the field of computer vision, which has also boosted considerable interest in digital pathology applications. Deep learning and its extensions have opened several avenues to tackle many challenging histopathological image analysis problems including color normalization, image segmentation, and the diagnosis/prognosis of human cancers. In this paper, we provide a comprehensive up-to-date review of the deep learning methods for digital H&E-stained pathology image analysis. Specifically, we first describe recent literature that uses deep learning for color normalization, which is one essential research direction for H&E-stained histopathological image analysis. Followed by the discussion of color normalization, we review applications of the deep learning method for various H&E-stained image analysis tasks such as nuclei and tissue segmentation. We also summarize several key clinical studies that use deep learning for the diagnosis and prognosis of human cancers from H&E-stained histopathological images. Finally, online resources and open research problems on pathological image analysis are also provided in this review for the convenience of researchers who are interested in this exciting field.
引用
收藏
页数:20
相关论文
共 132 条
[1]   Molecular Genetics of Renal Cell Tumors: A Practical Diagnostic Approach [J].
Alaghehbandan, Reza ;
Perez Montiel, Delia ;
Luis, Ana Silvia ;
Hes, Ondrej .
CANCERS, 2020, 12 (01)
[2]  
Anoraganingrum D., 1999, Proceedings 10th International Conference on Image Analysis and Processing, P1043, DOI 10.1109/ICIAP.1999.797734
[3]   QuPath: Open source software for digital pathology image analysis [J].
Bankhead, Peter ;
Loughrey, Maurice B. ;
Fernandez, Jose A. ;
Dombrowski, Yvonne ;
Mcart, Darragh G. ;
Dunne, Philip D. ;
McQuaid, Stephen ;
Gray, Ronan T. ;
Murray, Liam J. ;
Coleman, Helen G. ;
James, Jacqueline A. ;
Salto-Tellez, Manuel ;
Hamilton, Peter W. .
SCIENTIFIC REPORTS, 2017, 7
[4]   PathoFusion: An Open-Source AI Framework for Recognition of Pathomorphological Features and Mapping of Immunohistochemical Data [J].
Bao, Guoqing ;
Wang, Xiuying ;
Xu, Ran ;
Loh, Christina ;
Adeyinka, Oreoluwa Daniel ;
Pieris, Dula Asheka ;
Cherepanoff, Svetlana ;
Gracie, Gary ;
Lee, Maggie ;
McDonald, Kerrie L. ;
Nowak, Anna K. ;
Banati, Richard ;
Buckland, Michael E. ;
Graeber, Manuel B. .
CANCERS, 2021, 13 (04) :1-15
[5]   Adversarial Stain Transfer for Histopathology Image Analysis [J].
BenTaieb, Aicha ;
Hamarneh, Ghassan .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (03) :792-802
[6]   Efficient globally optimal segmentation of cells in fluorescence microscopy images using level sets and convex energy functionals [J].
Bergeest, Jan-Philip ;
Rohr, Karl .
MEDICAL IMAGE ANALYSIS, 2012, 16 (07) :1436-1444
[7]   Random forests [J].
Breiman, L .
MACHINE LEARNING, 2001, 45 (01) :5-32
[8]   Context-Based Normalization of Histological Stains Using Deep Convolutional Features [J].
Bug, D. ;
Schneider, S. ;
Grote, A. ;
Oswald, E. ;
Feuerhake, F. ;
Schueler, J. ;
Merhof, D. .
DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, 2017, 10553 :135-142
[9]   Breast Cancer Diagnosis by Convolutional Neural Network and Advanced Thermal Exchange Optimization Algorithm [J].
Cai, Xiuzhen ;
Li, Xia ;
Razmjooy, Navid ;
Ghadimi, Noradin .
COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2021, 2021
[10]   CellProfiler: image analysis software for identifying and quantifying cell phenotypes [J].
Carpenter, Anne E. ;
Jones, Thouis Ray ;
Lamprecht, Michael R. ;
Clarke, Colin ;
Kang, In Han ;
Friman, Ola ;
Guertin, David A. ;
Chang, Joo Han ;
Lindquist, Robert A. ;
Moffat, Jason ;
Golland, Polina ;
Sabatini, David M. .
GENOME BIOLOGY, 2006, 7 (10)