Reimagining T Staging Through Artificial Intelligence and Machine Learning Image Processing Approaches in Digital Pathology

被引:13
作者
Bera, Kaustav [1 ,2 ]
Katz, Ian [3 ,4 ]
Madabhushi, Anant [1 ,5 ]
机构
[1] Case Western Reserve Univ, Dept Biomed Engn, Cleveland, OH 44106 USA
[2] Maimonides Hosp, Dept Internal Med, Brooklyn, NY 11219 USA
[3] Southern Sun Pathol, Sydney, NSW, Australia
[4] Univ Queensland, Brisbane, Qld, Australia
[5] Louis Stokes Vet Affairs Med Ctr, Cleveland, OH USA
关键词
CELL LUNG-CANCER; PROGNOSTIC-FACTOR; FRACTAL DIMENSION; HISTOLOGIC GRADE; PROSTATE-CANCER; CARCINOMA; FEATURES; TUMOR; CLASSIFICATION; CHEMOTHERAPY;
D O I
10.1200/CCI.20.00110
中图分类号
R73 [肿瘤学];
学科分类号
100214 ;
摘要
Tumor stage and grade, visually assessed by pathologists from evaluation of pathology images in conjunction with radiographic imaging techniques, have been linked to outcome, progression, and survival for a number of cancers. The gold standard of staging in oncology has been the TNM (tumor-node-metastasis) staging system. Though histopathological grading has shown prognostic significance, it is subjective and limited by interobserver variability even among experienced surgical pathologists. Recently, artificial intelligence (AI) approaches have been applied to pathology images toward diagnostic-, prognostic-, and treatment prediction-related tasks in cancer. AI approaches have the potential to overcome the limitations of conventional TNM staging and tumor grading approaches, providing a direct prognostic prediction of disease outcome independent of tumor stage and grade. Broadly speaking, these AI approaches involve extracting patterns from images that are then compared against previously defined disease signatures. These patterns are typically categorized as either (1) handcrafted, which involve domain-inspired attributes, such as nuclear shape, or (2) deep learning (DL)-based representations, which tend to be more abstract. DL approaches have particularly gained considerable popularity because of the minimal domain knowledge needed for training, mostly only requiring annotated examples corresponding to the categories of interest. In this article, we discuss AI approaches for digital pathology, especially as they relate to disease prognosis, prediction of genomic and molecular alterations in the tumor, and prediction of treatment response in oncology. We also discuss some of the potential challenges with validation, interpretability, and reimbursement that must be addressed before widespread clinical deployment. The article concludes with a brief discussion of potential future opportunities in the field of AI for digital pathology and oncology. (C) 2020 by American Society of Clinical Oncology
引用
收藏
页码:1039 / 1050
页数:12
相关论文
共 82 条
[71]   Automated Classification of Lung Cancer Types from Cytological Images Using Deep Convolutional Neural Networks [J].
Teramoto, Atsushi ;
Tsukamoto, Tetsuya ;
Kiriyama, Yuka ;
Fujita, Hiroshi .
BIOMED RESEARCH INTERNATIONAL, 2017, 2017
[72]   Inter-observer reproducibility of HER2 immunohistochemical assessment and concordance with fluorescent in situ hybridization (FISH): pathologist assessment compared to quantitative image analysis [J].
Turashvili, Gulisa ;
Leung, Samuel ;
Turbin, Dmitry ;
Montgomery, Kelli ;
Gilks, Blake ;
West, Rob ;
Carrier, Melinda ;
Huntsman, David ;
Aparicio, Samuel .
BMC CANCER, 2009, 9
[73]   CT derived radiomic score for predicting the added benefit of adjuvant chemotherapy following surgery in stage I, II resectable non-small cell lung cancer: a retrospective multicohort study for outcome prediction [J].
Vaidya, Pranjal ;
Bera, Kaustav ;
Gupta, Amit ;
Wang, Xiangxue ;
Corredor, German ;
Fu, Pingfu ;
Beig, Niha ;
Prasanna, Prateek ;
Patil, Pradnya D. ;
Velu, Priya D. ;
Rajiah, Prabhakar ;
Gilkeson, Robert ;
Feldman, Michael D. ;
Choi, Humberto ;
Velcheti, Vamsidhar ;
Madabhushi, Anant .
LANCET DIGITAL HEALTH, 2020, 2 (03) :E116-E128
[74]  
Wang DH, 2015, IEEE ENG MED BIO, P2649, DOI 10.1109/EMBC.2015.7318936
[75]   ConvPath: A software tool for lung adenocarcinoma digital pathological image analysis aided by a convolutional neural network [J].
Wang, Shidan ;
Wang, Tao ;
Yang, Lin ;
Yang, Donghan M. ;
Fujimoto, Junya ;
Yi, Faliu ;
Luo, Xin ;
Yang, Yikun ;
Yao, Bo ;
Lin, ShinYi ;
Moran, Cesar ;
Kalhor, Neda ;
Weissferdt, Annikka ;
Minna, John ;
Xie, Yang ;
Wistuba, Ignacio I. ;
Mao, Yousheng ;
Xiao, Guanghua .
EBIOMEDICINE, 2019, 50 :103-110
[76]   Arrangement and Architecture of Tumor-Infiltrating Lymphocyte on H&E Slides Predict OS in Nivolumab Treated Non-Small Cell Lung Cancer [J].
Wang, X. ;
Barrera, C. ;
Bera, K. ;
Lu, C. ;
Feldman, M. ;
Schalper, K. ;
Rimm, D. ;
Velcheti, V. ;
Madabhushi, A. .
JOURNAL OF THORACIC ONCOLOGY, 2019, 14 (10) :S350-S351
[77]   Computer extracted features of cancer nuclei from H&E stained tissues of tumor predicts response to nivolumab in non-small cell lung cancer. [J].
Wang, Xiangxue ;
Barrera, Cristian ;
Velu, Priya ;
Bera, Kaustav ;
Prasanna, Prateek ;
Khunger, Monica ;
Khunger, Arjun ;
Velcheti, Vamsidhar ;
Madabhushi, Anant .
JOURNAL OF CLINICAL ONCOLOGY, 2018, 36 (15)
[78]   Prediction of recurrence in early stage non-small cell lung cancer using computer extracted nuclear features from digital H&E images [J].
Wang, Xiangxue ;
Janowczyk, Andrew ;
Zhou, Yu ;
Thawani, Rajat ;
Fu, Pingfu ;
Schalper, Kurt ;
Velcheti, Vamsidhar ;
Madabhushi, Anant .
SCIENTIFIC REPORTS, 2017, 7
[79]   The Cancer Genome Atlas Pan-Cancer analysis project [J].
Weinstein, John N. ;
Collisson, Eric A. ;
Mills, Gordon B. ;
Shaw, Kenna R. Mills ;
Ozenberger, Brad A. ;
Ellrott, Kyle ;
Shmulevich, Ilya ;
Sander, Chris ;
Stuart, Joshua M. .
NATURE GENETICS, 2013, 45 (10) :1113-1120
[80]   Stacked Sparse Autoencoder (SSAE) for Nuclei Detection on Breast Cancer Histopathology Images [J].
Xu, Jun ;
Xiang, Lei ;
Liu, Qingshan ;
Gilmore, Hannah ;
Wu, Jianzhong ;
Tang, Jinghai ;
Madabhushi, Anant .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2016, 35 (01) :119-130