Paired cycle-GAN-based image correction for quantitative cone-beam computed tomography

被引:239
作者
Harms, Joseph [1 ,2 ]
Lei, Yang [1 ,2 ]
Wang, Tonghe [1 ,2 ]
Zhang, Rongxiao [1 ,2 ]
Zhou, Jun [1 ,2 ]
Tang, Xiangyang [2 ,3 ]
Curran, Walter J. [1 ,2 ]
Liu, Tian [1 ,2 ]
Yang, Xiaofeng [1 ,2 ]
机构
[1] Emory Univ, Dept Radiat Oncol, Atlanta, GA 30322 USA
[2] Emory Univ, Winship Canc Inst, Atlanta, GA 30322 USA
[3] Emory Univ, Dept Radiol & Imaging Sci, Atlanta, GA 30322 USA
基金
美国国家卫生研究院;
关键词
adaptive radiation therapy; cycle-GAN; deep learning; image quality improvement; quantitative imaging; SCATTER CORRECTION; CT IMAGE; RADIATION;
D O I
10.1002/mp.13656
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Purpose The incorporation of cone-beam computed tomography (CBCT) has allowed for enhanced image-guided radiation therapy. While CBCT allows for daily 3D imaging, images suffer from severe artifacts, limiting the clinical potential of CBCT. In this work, a deep learning-based method for generating high quality corrected CBCT (CCBCT) images is proposed. Methods The proposed method integrates a residual block concept into a cycle-consistent adversarial network (cycle-GAN) framework, called res-cycle GAN, to learn a mapping between CBCT images and paired planning CT images. Compared with a GAN, a cycle-GAN includes an inverse transformation from CBCT to CT images, which constrains the model by forcing calculation of both a CCBCT and a synthetic CBCT. A fully convolution neural network with residual blocks is used in the generator to enable end-to-end CBCT-to-CT transformations. The proposed algorithm was evaluated using 24 sets of patient data in the brain and 20 sets of patient data in the pelvis. The mean absolute error (MAE), peak signal-to-noise ratio (PSNR), normalized cross-correlation (NCC) indices, and spatial non-uniformity (SNU) were used to quantify the correction accuracy of the proposed algorithm. The proposed method is compared to both a conventional scatter correction and another machine learning-based CBCT correction method. Results Overall, the MAE, PSNR, NCC, and SNU were 13.0 HU, 37.5 dB, 0.99, and 0.05 in the brain, 16.1 HU, 30.7 dB, 0.98, and 0.09 in the pelvis for the proposed method, improvements of 45%, 16%, 1%, and 93% in the brain, and 71%, 38%, 2%, and 65% in the pelvis, over the CBCT image. The proposed method showed superior image quality as compared to the scatter correction method, reducing noise and artifact severity. The proposed method produced images with less noise and artifacts than the comparison machine learning-based method. Conclusions The authors have developed a novel deep learning-based method to generate high-quality corrected CBCT images. The proposed method increases onboard CBCT image quality, making it comparable to that of the planning CT. With further evaluation and clinical implementation, this method could lead to quantitative adaptive radiation therapy.
引用
收藏
页码:3998 / 4009
页数:12
相关论文
共 35 条
[1]   Online Magnetic Resonance Image Guided Adaptive Radiation Therapy: First Clinical Applications [J].
Acharya, Sahaja ;
Fischer-Valuck, Benjamin W. ;
Kashani, Rojano ;
Parikh, Parag ;
Yang, Deshan ;
Zhao, Tianyu ;
Green, Olga ;
Wooten, Omar ;
Li, H. Harold ;
Hu, Yanle ;
Rodriguez, Vivian ;
Olsen, Lindsey ;
Robinson, Clifford ;
Michalski, Jeff ;
Mutic, Sasa ;
Olsen, Jeffrey .
INTERNATIONAL JOURNAL OF RADIATION ONCOLOGY BIOLOGY PHYSICS, 2016, 94 (02) :394-403
[2]   Efficient scatter distribution estimation and correction in CBCT using concurrent Monte Carlo fitting [J].
Bootsma, G. J. ;
Verhaegen, F. ;
Jaffray, D. A. .
MEDICAL PHYSICS, 2015, 42 (01) :54-68
[3]  
BRIECHLE K, OPT PATT REC
[4]   On the Fuzziness of Machine Learning, Neural Networks, and Artificial Intelligence in Radiation Oncology [J].
El Naqa, Issam ;
Brock, Kristy ;
Yu, Yan ;
Langen, Katja ;
Klein, Eric E. .
INTERNATIONAL JOURNAL OF RADIATION ONCOLOGY BIOLOGY PHYSICS, 2018, 100 (01) :1-4
[5]   Effect of scattered radiation on image noise in cone beam CT [J].
Endo, M ;
Tsunoo, T ;
Nakamori, N ;
Yoshida, K .
MEDICAL PHYSICS, 2001, 28 (04) :469-474
[6]   Automatic treatment planning based on three-dimensional dose distribution predicted from deep learning technique [J].
Fan, Jiawei ;
Wang, Jiazhou ;
Chen, Zhi ;
Hu, Chaosu ;
Zhang, Zhen ;
Hu, Weigang .
MEDICAL PHYSICS, 2019, 46 (01) :370-381
[7]  
Goodfellow I, 2014, ADV NEURAL INFO PROC
[8]   ScatterNet: A convolutional neural network for cone-beam CT intensity correction [J].
Hansen, David C. ;
Landry, Guillaume ;
Kamp, Florian ;
Li, Minglun ;
Belka, Claus ;
Parodi, Katia ;
Kurz, Christopher .
MEDICAL PHYSICS, 2018, 45 (11) :4916-4926
[9]  
He K., 2016, IEEE C COMPUT VIS PA, DOI [10.1007/978-3-319-46493-0_38, DOI 10.1007/978-3-319-46493-0_38, DOI 10.1109/CVPR.2016.90]
[10]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778