PPsNet: An improved deep learning model for microsatellite instability high prediction in colorectal cancer from whole slide images

被引:15
作者
Lou, Jingjiao [1 ]
Xu, Jiawen [2 ]
Zhang, Yuyan [1 ]
Sun, Yuhong [3 ]
Fang, Aiju [4 ]
Liu, Jixuan [2 ]
Mur, Luis A. J. [5 ]
Ji, Bing [1 ]
机构
[1] Shandong Univ, Sch Control Sci & Engn, 17923 Jingshi Rd, Jinan 250061, Shandong, Peoples R China
[2] Shandong First Med Univ, Dept Pathol, Shandong Prov Hosp, Jinan 250021, Shandong, Peoples R China
[3] Shandong First Med Univ & Shandong Canc Hosp, Shandong Acad Med Sci & Inst, Dept Pathol, Jinan 250117, Shandong, Peoples R China
[4] Shandong Univ, Shandong Prov Hosp 3, Dept Pathol, Jinan 250132, Shandong, Peoples R China
[5] Aberystwyth Univ, Inst Biol Environm & Rural Sci IBERS, Aberystwyth SY23 3DZ, Wales
关键词
Colorectal cancer; Microsatellite instability; Deep learning; Deep supervision; Pair -wise learning; Synergic network; Parameter sharing; Whole slide images; CLASSIFICATION;
D O I
10.1016/j.cmpb.2022.107095
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and Objective: Recent studies have shown that colorectal cancer (CRC) patients with mi-crosatellite instability high (MSI-H) are more likely to benefit from immunotherapy. However, current MSI testing methods are not available for all patients due to the lack of available equipment and trained personnel, as well as the high cost of the assay. Here, we developed an improved deep learning model to predict MSI-H in CRC from whole slide images (WSIs).Methods: We established the MSI-H prediction model based on two stages: tumor detection and MSI classification. Previous works applied fine-tuning strategy directly for tumor detection, but ignoring the challenge of vanishing gradient due to the large number of convolutional layers. We added auxiliary clas-sifiers to intermediate layers of pre-trained models to help propagate gradients back through in an effec-tive manner. To predict MSI status, we constructed a pair-wise learning model with a synergic network, named parameter partial sharing network (PPsNet), where partial parameters are shared among two deep convolutional neural networks (DCNNs). The proposed PPsNet contained fewer parameters and reduced the problem of intra-class variation and inter-class similarity. We validated the proposed model on a holdout test set and two external test sets.Results: 144 H&E-stained WSIs from 144 CRC patients (81 cases with MSI-H and 63 cases with MSI-L/MSS) were collected retrospectively from three hospitals. The experimental results indicate that deep supervision based fine-tuning almost outperforms training from scratch and utilizing fine-tuning directly. The proposed PPsNet always achieves better accuracy and area under the receiver operating characteris-tic curve (AUC) than other solutions with four different neural network architectures on validation. The proposed method finally achieves obvious improvements than other state-of-the-art methods on the val-idation dataset with an accuracy of 87.28% and AUC of 94.29%.Conclusions: The proposed method can obviously increase model performance and our model yields bet-ter performance than other methods. Additionally, this work also demonstrates the feasibility of MSI-H prediction using digital pathology images based on deep learning in the Asian population. It is hoped that this model could serve as an auxiliary tool to identify CRC patients with MSI-H more time-saving and efficiently.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:10
相关论文
共 46 条
[1]   Emerging Themes in Image Informatics and Molecular Analysis for Digital Pathology [J].
Bhargava, Rohit ;
Madabhushi, Anant .
ANNUAL REVIEW OF BIOMEDICAL ENGINEERING, VOL 18, 2016, 18 :387-412
[2]  
Bray F, 2018, CA-CANCER J CLIN, V68, P394, DOI [10.3322/caac.21492, 10.3322/caac.21609]
[3]   Development and interpretation of a pathomics-based model for the prediction of microsatellite instability in Colorectal Cancer [J].
Cao, Rui ;
Yang, Fan ;
Ma, Si-Cong ;
Liu, Li ;
Zhao, Yu ;
Li, Yan ;
Wu, De-Hua ;
Wang, Tongxin ;
Lu, Wei-Jia ;
Cai, Wei-Jing ;
Zhu, Hong-Bo ;
Guo, Xue-Jun ;
Lu, Yu-Wen ;
Kuang, Jun-Jie ;
Huan, Wen-Jing ;
Tang, Wei-Min ;
Huang, Kun ;
Huang, Junzhou ;
Yao, Jianhua ;
Dong, Zhong-Yi .
THERANOSTICS, 2020, 10 (24) :11080-11091
[4]   Interactive thyroid whole slide image diagnostic system using deep representation [J].
Chen, Pingjun ;
Shi, Xiaoshuang ;
Liang, Yun ;
Li, Yuan ;
Yang, Lin ;
Gader, Paul D. .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2020, 195
[5]  
Chen T, 2020, PR MACH LEARN RES, V119
[6]   Exploring Simple Siamese Representation Learning [J].
Chen, Xinlei ;
He, Kaiming .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :15745-15753
[7]   Learning a similarity metric discriminatively, with application to face verification [J].
Chopra, S ;
Hadsell, R ;
LeCun, Y .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :539-546
[8]  
Ciompi F, 2017, I S BIOMED IMAGING, P160, DOI 10.1109/ISBI.2017.7950492
[9]   Automatic classification of pulmonary peri-fissural nodules in computed tomography using an ensemble of 2D views and a convolutional neural network out-of-the-box [J].
Ciompi, Francesco ;
de Hoop, Bartjan ;
van Riel, Sarah J. ;
Chung, Kaman ;
Scholten, Ernst Th. ;
Oudkerk, Matthijs ;
de Jong, Pim A. ;
Prokop, Mathias ;
van Ginneken, Bram .
MEDICAL IMAGE ANALYSIS, 2015, 26 (01) :195-202
[10]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848