DeepPrognosis: Preoperative prediction of pancreatic cancer survival and surgical margin via comprehensive understanding of dynamic contrast-enhanced CT imaging and tumor-vascular contact parsing

被引:41
作者
Yao, Jiawen [1 ]
Shi, Yu [2 ]
Cao, Kai [3 ]
Lu, Le [1 ]
Lu, Jianping [3 ]
Song, Qike [2 ]
Jin, Gang [4 ]
Xiao, Jing [5 ]
Hou, Yang [2 ]
Zhang, Ling [1 ]
机构
[1] PAII Inc, Bethesda, MD 20817 USA
[2] China Med Univ, Dept Radiol, Shengjing Hosp, Shenyang, Peoples R China
[3] Changhai Hosp, Dept Radiol, Shanghai, Peoples R China
[4] Changhai Hosp, Dept Surg, Shanghai, Peoples R China
[5] Ping An Technol, Shenzhen, Peoples R China
基金
中国国家自然科学基金;
关键词
Pancreatic ductal adenocarcinoma (PDAC); 3D contrast-enhanced convolutional LSTM (CE-ConvLSTM); Preoperative survival prediction; Resection margin prediction; DUCTAL ADENOCARCINOMA; VALIDATION; BIOMARKERS; SYSTEM;
D O I
10.1016/j.media.2021.102150
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Pancreatic ductal adenocarcinoma (PDAC) is one of the most lethal cancers and carries a dismal prognosis of similar to 10% in five year survival rate. Surgery remains the best option of a potential cure for patients who are evaluated to be eligible for initial resection of PDAC. However, outcomes vary significantly even among the resected patients who were the same cancer stage and received similar treatments. Accurate quantitative preoperative prediction of primary resectable PDACs for personalized cancer treatment is thus highly desired. Nevertheless, there are a very few automated methods yet to fully exploit the contrast-enhanced computed tomography (CE-CT) imaging for PDAC prognosis assessment. CE-CT plays a critical role in PDAC staging and resectability evaluation. In this work, we propose a novel deep neural network model for the survival prediction of primary resectable PDAC patients, named as 3D Contrast-Enhanced Convolutional Long Short-Term Memory network (CE-ConvLSTM), which can derive the tumor attenuation signatures or patterns from patient CE-CT imaging studies. Tumor-vascular relationships, which might indicate the resection margin status, have also been proven to hold strong relationships with the overall survival of PDAC patients. To capture such relationships, we propose a self-learning approach for automated pancreas and peripancreatic anatomy segmentation without requiring any annotations on our PDAC datasets. We then employ a multi-task convolutional neural network (CNN) to accomplish both tasks of survival outcome and margin prediction where the network benefits from learning the resection margin related image features to improve the survival prediction. Our presented framework can improve overall survival prediction performances compared with existing state-of-the-art survival analysis approaches. The new staging biomarker integrating both the proposed risk signature and margin prediction has evidently added values to be combined with the current clinical staging system. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:16
相关论文
共 77 条
[71]   DeepPap: Deep Convolutional Networks for Cervical Cell Classification [J].
Zhang, Ling ;
Lu, Le ;
Nogues, Isabella ;
Summers, Ronald M. ;
Liu, Shaoxiong ;
Yao, Jianhua .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2017, 21 (06) :1633-1643
[72]  
Zhao T, P IEEE CVF C COMP VI, P13743
[73]   A review: Deep learning for medical image segmentation using multi-modality fusion [J].
Zhou, Tongxue ;
Ruan, Su ;
Canu, Stephane .
ARRAY, 2019, 3-4
[74]   WSISA: Making Survival Prediction from Whole Slide Histopathological Images [J].
Zhu, Xinliang ;
Yao, Jiawen ;
Zhu, Feiyun ;
Huang, Junzhou .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6855-6863
[75]  
Zhu XL, 2016, IEEE INT C BIOINFORM, P544, DOI 10.1109/BIBM.2016.7822579
[76]   Multi-scale Coarse-to-Fine Segmentation for Screening Pancreatic Ductal Adenocarcinoma [J].
Zhu, Zhuotun ;
Xia, Yingda ;
Xie, Lingxi ;
Fishman, Elliot K. ;
Yuille, Alan L. .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT VI, 2019, 11769 :3-12
[77]   A 3D Coarse-to-Fine Framework for Volumetric Medical Image Segmentation [J].
Zhu, Zhuotun ;
Xia, Yingda ;
Shen, Wei ;
Fishman, Elliot K. ;
Yuille, Alan L. .
2018 INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2018, :682-690