GAN-based survival prediction model from CT images of patients with idiopathic pulmonary fibrosis

被引:3
作者
Uemuraa, Tomoki [1 ,2 ,3 ]
Watari, Chinatsu [1 ,2 ]
Nappi, Janne J. [1 ,2 ]
Hironaka, Toru [1 ,2 ]
Kim, Hyoungseop [3 ]
Yoshida, Hiroyuki [1 ,2 ]
机构
[1] Massachusetts Gen Hosp, Dept Radiol, 3D Imaging Res, 25 New Chardon St,Suite 400C, Boston, MA 02114 USA
[2] Harvard Med Sch, 25 New Chardon St,Suite 400C, Boston, MA 02114 USA
[3] Kyushu Inst Technol, Dept Mech & Control Engn, 1-1 Sensui Cho, Kitakyushu, Fukuoka 8048550, Japan
来源
MEDICAL IMAGING 2020: IMAGING INFORMATICS FOR HEALTHCARE, RESEARCH, AND APPLICATIONS | 2020年 / 11318卷
关键词
generative adversarial networks; survival analysis; radiomics; deep learning; interstitial lung disease; idiopathic pulmonary fibrosis; RADIOMICS;
D O I
10.1117/12.2551369
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
We developed a novel survival prediction model for images, called pix2surv, based on a conditional generative adversarial network (cGAN), and evaluated its performance based on chest CT images of patients with idiopathic pulmonary fibrosis (IPF). The architecture of the pix2sury model has a time-generator network that consists of an encoding convolutional network, a fully connected prediction network, and a discriminator network. The fully connected prediction network is trained to generate survival-time images from the chest CT images of each patient. The discriminator network is a patch-based convolutional network that is trained to differentiate the "fake pair" of a chest CT image and a generated survival-time image from the "true pair" of an input CT image and the observed survival-time image of a patient. For evaluation, we retrospectively collected 75 IPF patients with high-resolution chest CT and pulmonary function tests. The survival predictions of the pix2sury model on these patients were compared with those of an established clinical prognostic biomarker known as the gender, age, and physiology (GAP) index by use of a two-sided t-test with bootstrapping. Concordance index (C-index) and relative absolute error (RAE) were used as measures of the prediction performance. Preliminary results showed that the survival prediction by the pix2sury model yielded more than 15% higher C-index value and more than 10% lower RAE values than those of the GAP index. The improvement in survival prediction by the pix2sury model was statistically significant (P < 0.0001). Also, the separation between the survival curves for the low- and high-risk groups was larger with pix2sury than that of the GAP index. These results show that the pix2sury model outperforms the GAP index in the prediction of the survival time and risk stratification of patients with IPF, indicating that the pix2sury model can be an effective predictor of the overall survival of patients with IPF.
引用
收藏
页数:6
相关论文
共 19 条
[1]   From Handcrafted to Deep-Learning-Based Cancer Radiomics Challenges and opportunities [J].
Afshar, Parnian ;
Mohammadi, Arash ;
Plataniotis, Konstantinos N. ;
Oikonomou, Anastasia ;
Benali, Habib .
IEEE SIGNAL PROCESSING MAGAZINE, 2019, 36 (04) :132-160
[2]   Idiopathic Pulmonary Fibrosis in United States Automated Claims Incidence, Prevalence, and Algorithm Validation [J].
Esposito, Daina B. ;
Lanes, Stephan ;
Donneyong, Macarius ;
Holick, Crystal N. ;
Lasky, Joseph A. ;
Lederer, David ;
Nathan, Steven D. ;
O'Quinn, Sean ;
Parker, Joseph ;
Tran, Trung N. .
AMERICAN JOURNAL OF RESPIRATORY AND CRITICAL CARE MEDICINE, 2015, 192 (10) :1200-1207
[3]   Radiomics and Artificial Intelligence for Biomarker and Prediction Model Development in Oncology [J].
Forghani, Reza ;
Savadjiev, Peter ;
Chatterjee, Avishek ;
Muthukrishnan, Nikesh ;
Reinhold, Caroline ;
Forghani, Behzad .
COMPUTATIONAL AND STRUCTURAL BIOTECHNOLOGY JOURNAL, 2019, 17 :995-1008
[4]   Radiomics: Images Are More than Pictures, They Are Data [J].
Gillies, Robert J. ;
Kinahan, Paul E. ;
Hricak, Hedvig .
RADIOLOGY, 2016, 278 (02) :563-577
[5]   The European IPF registry (eurIPFreg): baseline characteristics and survival of patients with idiopathic pulmonary fibrosis [J].
Guenther, Andreas ;
Krauss, Ekaterina ;
Tello, Silke ;
Wagner, Jasmin ;
Paul, Bettina ;
Kuhn, Stefan ;
Maurer, Olga ;
Heinemann, Sabine ;
Costabel, Ulrich ;
Nieto Barbero, Maria Asuncion ;
Mueller, Veronika ;
Bonniaud, Philippe ;
Vancheri, Carlo ;
Wells, Athol ;
Vasakova, Martina ;
Pesci, Alberto ;
Sofia, Matteo ;
Klepetko, Walter ;
Seeger, Werner ;
Drakopanagiotakis, Fotios ;
Crestani, Bruno .
RESPIRATORY RESEARCH, 2018, 19
[6]   EVALUATING THE YIELD OF MEDICAL TESTS [J].
HARRELL, FE ;
CALIFF, RM ;
PRYOR, DB ;
LEE, KL ;
ROSATI, RA .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 1982, 247 (18) :2543-2546
[7]   Handcrafted versus deep learning radiomics for prediction of cancer therapy response [J].
Hosny, Ahmed ;
Aerts, Hugo J. ;
Mak, Raymond H. .
LANCET DIGITAL HEALTH, 2019, 1 (03) :E106-E107
[8]   Global incidence and mortality of idiopathic pulmonary fibrosis: a systematic review [J].
Hutchinson, John ;
Fogarty, Andrew ;
Hubbard, Richard ;
McKeever, Tricia .
EUROPEAN RESPIRATORY JOURNAL, 2015, 46 (03) :795-806
[9]   Image-to-Image Translation with Conditional Adversarial Networks [J].
Isola, Phillip ;
Zhu, Jun-Yan ;
Zhou, Tinghui ;
Efros, Alexei A. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5967-5976
[10]   Longitudinal prediction of outcome in idiopathic pulmonary fibrosis using automated CT analysis [J].
Jacob, Joseph ;
Bartholmai, Brian J. ;
van Moorsel, Coline H. M. ;
Rajagopalan, Srinivasan ;
Devaraj, Anand ;
van Es, Hendrik W. ;
Moua, Teng ;
van Beek, Frouke T. ;
Clay, Ryan ;
Veltkamp, Marcel ;
Kokosi, Maria ;
de lauretis, Angelo ;
Judge, Eoin P. ;
Jacob, Teresa M. ;
Peikert, Tobias ;
Karwoski, Ronald ;
Maldonado, Fabien ;
Renzoni, Elisabetta ;
Maher, Toby M. ;
Altmann, Andre ;
Wells, Athol U. .
EUROPEAN RESPIRATORY JOURNAL, 2019, 54 (03)