DeepPET: A deep encoder-decoder network for directly solving the PET image reconstruction inverse problem

被引:218
作者
Haggstrom, Ida [1 ]
Schmidtlein, C. Ross [1 ]
Campanella, Gabriele [1 ,3 ]
Fuchs, Thomas J. [1 ,2 ,3 ]
机构
[1] Mem Sloan Kettering Canc Ctr, Dept Med Phys, New York, NY 10065 USA
[2] Mem Sloan Kettering Canc Ctr, Dept Pathol, New York, NY 10065 USA
[3] Weill Cornell Med, Dept Physiol & Biophys, New York, NY 10065 USA
关键词
CONVOLUTIONAL NEURAL-NETWORK; CT RECONSTRUCTION; TOMOGRAPHY; PROJECTION;
D O I
10.1016/j.media.2019.03.013
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The purpose of this research was to implement a deep learning network to overcome two of the major bottlenecks in improved image reconstruction for clinical positron emission tomography (PET). These are the lack of an automated means for the optimization of advanced image reconstruction algorithms, and the computational expense associated with these state-of-the art methods. We thus present a novel end-to-end PET image reconstruction technique, called DeepPET, based on a deep convolutional encoder-decoder network, which takes PET sinogram data as input and directly and quickly outputs high quality, quantitative PET images. Using simulated data derived from a whole-body digital phantom, we randomly sampled the configurable parameters to generate realistic images, which were each augmented to a total of more than 291,000 reference images. Realistic PET acquisitions of these images were simulated, resulting in noisy sinogram data, used for training, validation, and testing the DeepPET network. We demonstrated that DeepPET generates higher quality images compared to conventional techniques, in terms of relative root mean squared error (11%/53% lower than ordered subset expectation maximization (OSEM)/filtered back-projection (FBP), structural similarity index (1%/11% higher than OSEM/FBP), and peak signal-to-noise ratio (1.1/3.8 dB higher than OSEM/FBP). In addition, we show that DeepPET reconstructs images 108 and 3 times faster than OSEM and FBP, respectively. Finally, DeepPET was successfully applied to real clinical data. This study shows that an end-to-end encoder-decoder network can produce high quality PET images at a fraction of the time compared to conventional methods. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:253 / 262
页数:10
相关论文
共 33 条
[1]   Learned Primal-Dual Reconstruction [J].
Adler, Jonas ;
Oktem, Ozan .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) :1322-1332
[2]   Globally convergent image reconstruction for emission tomography using relaxed ordered subsets algorithms [J].
Ahn, S ;
Fessler, JA .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2003, 22 (05) :613-626
[3]   PETSTEP: Generation of synthetic PET lesions for fast evaluation of segmentation methods [J].
Berthon, Beatrice ;
Haggstrom, Ida ;
Apte, Aditya ;
Beattie, Bradley J. ;
Kirov, Assen S. ;
Humm, John L. ;
Marshall, Christopher ;
Spezi, Emiliano ;
Larsson, Anne ;
Schmidtlein, C. Ross .
PHYSICA MEDICA-EUROPEAN JOURNAL OF MEDICAL PHYSICS, 2015, 31 (08) :969-980
[4]   Statistical Iterative CBCT Reconstruction Based on Neural Network [J].
Chen, Binbin ;
Xiang, Kai ;
Gong, Zaiwen ;
Wang, Jing ;
Tan, Shan .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) :1511-1521
[5]   LEARN: Learned Experts' Assessment-Based Reconstruction Network for Sparse-Data CT [J].
Chen, Hu ;
Zhang, Yi ;
Chen, Yunjin ;
Zhang, Junfeng ;
Zhang, Weihua ;
Sun, Huaiqiang ;
Lv, Yang ;
Liao, Peixi ;
Zhou, Jiliu ;
Wang, Ge .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) :1333-1347
[6]   Low-Dose CT With a Residual Encoder-Decoder Convolutional Neural Network [J].
Chen, Hu ;
Zhang, Yi ;
Kalra, Mannudeep K. ;
Lin, Feng ;
Chen, Yang ;
Liao, Peixi ;
Zhou, Jiliu ;
Wang, Ge .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2017, 36 (12) :2524-2535
[7]   Deep reconstruction model for dynamic PET images [J].
Cui, Jianan ;
Liu, Xin ;
Wang, Yile ;
Liu, Huafeng .
PLOS ONE, 2017, 12 (09)
[8]   PENALIZED WEIGHTED LEAST-SQUARES IMAGE-RECONSTRUCTION FOR POSITRON EMISSION TOMOGRAPHY [J].
FESSLER, JA .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 1994, 13 (02) :290-300
[9]   Iterative PET Image Reconstruction Using Convolutional Neural Network Representation [J].
Gong, Kuang ;
Guan, Jiahui ;
Kim, Kyungsang ;
Zhang, Xuezhu ;
Yang, Jaewon ;
Seo, Youngho ;
El Fakhri, Georges ;
Qi, Jinyi ;
Li, Quanzheng .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (03) :675-685
[10]   CNN-Based Projected Gradient Descent for Consistent CT Image Reconstruction [J].
Gupta, Harshit ;
Jin, Kyong Hwan ;
Nguyen, Ha Q. ;
McCann, Michael T. ;
Unser, Michael .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) :1440-1453