A study of Bayesian deep network uncertainty and its application to synthetic CT generation for MR-only radiotherapy treatment planning

被引:3
作者
Law, Max Wai-Kong [1 ,3 ]
Tse, Mei-Yan [1 ]
Ho, Leon Chin-Chak [1 ]
Lau, Ka-Ki [1 ]
Wong, Oi Lei [2 ]
Yuan, Jing [2 ]
Cheung, Kin Yin [1 ]
Yu, Siu Ki [1 ]
机构
[1] Hong Kong Sanat & Hosp, Med Phys Dept, Hong Kong, Peoples R China
[2] Hong Kong Sanat & Hosp, Res Dept, Hong Kong, Peoples R China
[3] Hong Kong Sanat & Hosp, Eastern Med Ctr, Med Phys Dept, Hong Kong, Peoples R China
关键词
Bayesian; MR-Only planning; Synthetic CT; CONVOLUTIONAL NEURAL-NETWORK; THERAPY; IMAGE; SIMULATION;
D O I
10.1002/mp.16666
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
BackgroundThe use of synthetic computed tomography (CT) for radiotherapy treatment planning has received considerable attention because of the absence of ionizing radiation and close spatial correspondence to source magnetic resonance (MR) images, which have excellent tissue contrast. However, in an MR-only environment, little effort has been made to examine the quality of synthetic CT images without using the original CT images.PurposeTo estimate synthetic CT quality without referring to original CT images, this study established the relationship between synthetic CT uncertainty and Bayesian uncertainty, and proposed a new Bayesian deep network for generating synthetic CT images and estimating synthetic CT uncertainty for MR-only radiotherapy treatment planning.Methods and MaterialsA novel deep Bayesian network was formulated using probabilistic network weights. Two mathematical expressions were proposed to quantify the Bayesian uncertainty of the network and synthetic CT uncertainty, which was closely related to the mean absolute error (MAE) in Hounsfield Unit (HU) of synthetic CT. These uncertainties were examined to demonstrate the accuracy of representing the synthetic CT uncertainty using a Bayesian counterpart. We developed a hybrid Bayesian architecture and a new data normalization scheme, enabling the Bayesian network to generate both accurate synthetic CT and reliable uncertainty information when probabilistic weights were applied. The proposed method was evaluated in 59 patients (13/12/32/2 for training/validation/testing/uncertainty visualization) diagnosed with prostate cancer, who underwent same-day pelvic CT- and MR-acquisitions. To assess the relationship between Bayesian and synthetic CT uncertainties, linear and non-linear correlation coefficients were calculated on per-voxel, per-tissue, and per-patient bases. For accessing the accuracy of the CT number and dosimetric accuracy, the proposed method was compared with a commercially available atlas-based method (MRCAT) and a U-Net conditional-generative adversarial network (UcGAN).ResultsThe proposed model exhibited 44.33 MAE, outperforming UcGAN 52.51 and MRCAT 54.87. The gamma rate (2%/2 mm dose difference/distance to agreement) of the proposed model was 98.68%, comparable to that of UcGAN (98.60%) and MRCAT (98.56%). The per-patient and per-tissue linear correlation coefficients between the Bayesian and synthetic CT uncertainties ranged from 0.53 to 0.83, implying a moderate to strong linear correlation. Per-voxel correlation coefficients varied from -0.13 to 0.67 depending on the regions-of-interest evaluated, indicating tissue-dependent correlation. The R2 value for estimating MAE solely using Bayesian uncertainty was 0.98, suggesting that the uncertainty of the proposed model was an ideal candidate for predicting synthetic CT error, without referring to the original CT.ConclusionThis study established a relationship between the Bayesian model uncertainty and synthetic CT uncertainty. A novel Bayesian deep network was proposed to generate a synthetic CT and estimate its uncertainty. Various metrics were used to thoroughly examine the relationship between the uncertainties of the proposed Bayesian model and the generated synthetic CT. Compared with existing approaches, the proposed model showed comparable CT number and dosimetric accuracies. The experiments showed that the proposed Bayesian model was capable of producing accurate synthetic CT, and was an effective indicator of the uncertainty and error associated with synthetic CT in MR-only workflows.
引用
收藏
页码:1244 / 1262
页数:19
相关论文
共 49 条
  • [11] Generating synthetic CTs from magnetic resonance images using generative adversarial networks
    Emami, Hajar
    Dong, Ming
    Nejad-Davarani, Siamak P.
    Glide-Hurst, Carri K.
    [J]. MEDICAL PHYSICS, 2018, 45 (08) : 3627 - 3636
  • [12] Dosimetric evaluation of an atlas-based synthetic CT generation approach for MR-only radiotherapy of pelvis anatomy
    Farjam, Reza
    Tyag, Neelam
    Deasy, Joseph O.
    Hun, Margie A.
    [J]. JOURNAL OF APPLIED CLINICAL MEDICAL PHYSICS, 2019, 20 (01): : 101 - 109
  • [13] Gal Yarin, 2016, Uncertainty in deep learning, V1, P3
  • [14] Task group 284 report: magnetic resonance imaging simulation in radiotherapy: considerations for clinical implementation, optimization, and quality assurance
    Glide-Hurst, Carri K.
    Paulson, Eric S.
    McGee, Kiaran
    Tyagi, Neelam
    Hu, Yanle
    Balter, James
    Bayouth, John
    [J]. MEDICAL PHYSICS, 2021, 48 (07) : E636 - E670
  • [15] MR-based synthetic CT generation using a deep convolutional neural network method
    Han, Xiao
    [J]. MEDICAL PHYSICS, 2017, 44 (04) : 1408 - 1419
  • [16] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [17] Hemsely M., 2020, INT C MED IM COMP CO
  • [18] Synthetic CT generation for MRI-guided adaptive radiotherapy in prostate cancer
    Hsu, Shu-Hui
    Han, Zhaohui
    Leeman, Jonathan E.
    Hu, Yue-Houng
    Mak, Raymond H.
    Sudhyadhom, Atchar
    [J]. FRONTIERS IN ONCOLOGY, 2022, 12
  • [19] Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods
    Huellermeier, Eyke
    Waegeman, Willem
    [J]. MACHINE LEARNING, 2021, 110 (03) : 457 - 506
  • [20] Dosimetric evaluation of synthetic CT generated with GANs for MRI-only proton therapy treatment planning of brain tumors
    Kazemifar, Samaneh
    Montero, Ana M. Barragan
    Souris, Kevin
    Rivas, Sara T.
    Timmerman, Robert
    Park, Yang K.
    Jiang, Steve
    Geets, Xavier
    Sterpin, Edmond
    Owrangi, Amir
    [J]. JOURNAL OF APPLIED CLINICAL MEDICAL PHYSICS, 2020, 21 (05): : 76 - 86