DeepTree: Pathological Image Classification Through Imitating Tree-Like Strategies of Pathologists

被引:7
作者
Li, Jiawen [1 ]
Cheng, Junru [1 ]
Meng, Lingqin [1 ]
Yan, Hui [1 ]
He, Yonghong [1 ]
Shi, Huijuan [2 ]
Guan, Tian [1 ]
Han, Anjia [2 ]
机构
[1] Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R China
[2] Sun Yat Sen Univ, Affiliated Hosp 1, Dept Pathol, Guangzhou 510080, Peoples R China
基金
美国国家科学基金会;
关键词
Pathology; Morphology; Tumors; Lesions; Feature extraction; Deep learning; Image classification; pathological image classification; prior knowledge in pathology; tree-like strategies; CANCER; DIAGNOSIS;
D O I
10.1109/TMI.2023.3341846
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Digitization of pathological slides has promoted the research of computer-aided diagnosis, in which artificial intelligence analysis of pathological images deserves attention. Appropriate deep learning techniques in natural images have been extended to computational pathology. Still, they seldom take into account prior knowledge in pathology, especially the analysis process of lesion morphology by pathologists. Inspired by the diagnosis decision of pathologists, we design a novel deep learning architecture based on tree-like strategies called DeepTree. It imitates pathological diagnosis methods, designed as a binary tree structure, to conditionally learn the correlation between tissue morphology, and optimizes branches to finetune the performance further. To validate and benchmark DeepTree, we build a dataset of frozen lung cancer tissues and design experiments on a public dataset of breast tumor subtypes and our dataset. Results show that the deep learning architecture based on tree-like strategies makes the pathological image classification more accurate, transparent, and convincing. Simultaneously, prior knowledge based on diagnostic strategies yields superior representation ability compared to alternative methods. Our proposed methodology helps improve the trust of pathologists in artificial intelligence analysis and promotes the practical clinical application of pathology-assisted diagnosis.
引用
收藏
页码:1501 / 1512
页数:12
相关论文
共 45 条
[1]   Molecular Pathology of Non-Small Cell Lung Cancer A Practical Guide [J].
Aisner, Dara L. ;
Marshall, Carrie B. .
AMERICAN JOURNAL OF CLINICAL PATHOLOGY, 2012, 138 (03) :332-346
[2]   BACH: Grand challenge on breast cancer histology images [J].
Aresta, Guilherme ;
Araujo, Teresa ;
Kwok, Scotty ;
Chennamsetty, Sai Saketh ;
Safwan, Mohammed ;
Alex, Varghese ;
Marami, Bahram ;
Prastawa, Marcel ;
Chan, Monica ;
Donovan, Michael ;
Fernandez, Gerardo ;
Zeineh, Jack ;
Kohl, Matthias ;
Walz, Christoph ;
Ludwig, Florian ;
Braunewell, Stefan ;
Baust, Maximilian ;
Quoc Dang Vu ;
Minh Nguyen Nhat To ;
Kim, Eal ;
Kwak, Jin Tae ;
Galal, Sameh ;
Sanchez-Freire, Veronica ;
Brancati, Nadia ;
Frucci, Maria ;
Riccio, Daniel ;
Wang, Yaqi ;
Sun, Lingling ;
Ma, Kaiqiang ;
Fang, Jiannan ;
Kone, Ismael ;
Boulmane, Lahsen ;
Campilho, Aurelio ;
Eloy, Catarina ;
Polonia, Antonio ;
Aguiar, Paulo .
MEDICAL IMAGE ANALYSIS, 2019, 56 :122-139
[3]  
Ba LJ, 2014, ADV NEUR IN, V27
[4]  
Bartz-Beielstein T., 2010, Experimental methods for the analysis of optimization algorithms
[5]   BRACS: A Dataset for BReAst Carcinoma Subtyping in H&E Histology Images [J].
Brancati, Nadia ;
Anniciello, Anna Maria ;
Pati, Pushpak ;
Riccio, Daniel ;
Scognamiglio, Giosue ;
Jaume, Guillaume ;
De Pietro, Giuseppe ;
Di Bonito, Maurizio ;
Foncubierta, Antonio ;
Botti, Gerardo ;
Gabrani, Maria ;
Feroce, Florinda ;
Frucci, Maria .
DATABASE-THE JOURNAL OF BIOLOGICAL DATABASES AND CURATION, 2022, 2022
[6]   Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning [J].
Coudray, Nicolas ;
Ocampo, Paolo Santiago ;
Sakellaropoulos, Theodore ;
Narula, Navneet ;
Snuderl, Matija ;
Fenyo, David ;
Moreira, Andre L. ;
Razavian, Narges ;
Tsirigos, Aristotelis .
NATURE MEDICINE, 2018, 24 (10) :1559-+
[7]   One-factor-at-a-time versus designed experiments [J].
Czitrom, V .
AMERICAN STATISTICIAN, 1999, 53 (02) :126-131
[8]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[9]   Deep learning in digital pathology image analysis: a survey [J].
Deng, Shujian ;
Zhang, Xin ;
Yan, Wen ;
Chang, Eric I-Chao ;
Fan, Yubo ;
Lai, Maode ;
Xu, Yan .
FRONTIERS OF MEDICINE, 2020, 14 (04) :470-487
[10]   The impact of the aging population and incidence of cancer on future projections of general surgical workforce needs [J].
Ellison, E. Christopher ;
Pawlik, Timothy M. ;
Way, David P. ;
Satiani, Bhagwan ;
Williams, Thomas E. .
SURGERY, 2018, 163 (03) :553-559