Development of an unsupervised cycle contrastive unpaired translation network for MRI-to-CT synthesis

被引:12
作者
Wang, Jiangtao [1 ,2 ]
Yan, Bing [3 ]
Wu, Xinhong [1 ]
Jiangl, Xiao [1 ]
Zuo, Yang [1 ,3 ]
Yang, Yidong [1 ,3 ]
机构
[1] Univ Sci & Technol China, Dept Engn & Appl Phys, Hefei, Anhui, Peoples R China
[2] Sichuan Acad Med Sci, Sichuan Prov Peoples Hosp, Canc Ctr, Chengdu, Sichuan, Peoples R China
[3] Univ Sci & Technol China, Affiliated Hosp USTC 1, Div Life Sci & Med, Dept Radiat Oncol, Hefei 230001, Anhui, Peoples R China
关键词
contrastive unpaired translation network; cycle-consistent generative adversarial network; MRI-only workflow; synthetic CT; CONVOLUTIONAL NEURAL-NETWORK; IMAGE; NECK; HEAD;
D O I
10.1002/acm2.13775
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Purpose The purpose of this work is to develop and evaluate a novel cycle-contrastive unpaired translation network (cycleCUT) for synthetic computed tomography (sCT) generation from T1-weighted magnetic resonance images (MRI). Methods The cycleCUT proposed in this work integrated the contrastive learning module from contrastive unpaired translation network (CUT) into the cycle-consistent generative adversarial network (cycleGAN) framework to effectively achieve unsupervised CT synthesis from MRI. The diagnostic MRI and radiotherapy planning CT images of 24 brain cancer patients were obtained and reshuffled to train the network. For comparison, the traditional cycleGAN and CUT were also implemented. The sCT images were then imported into a treatment planning system to verify their feasibility for radiotherapy planning. The mean absolute error (MAE), peak signal-to-noise ratio (PSNR), and structural similarity index (SSIM) between the sCT and the corresponding real CT images were calculated. Gamma analysis between sCT- and CT-based dose distributions was also conducted. Results Quantitative evaluation of an independent test set of six patients showed that the average MAE was 69.62 +/- 5.68 Hounsfield Units (HU) for the proposed cycleCUT, significantly (p-value < 0.05) lower than that for cycleGAN (77.02 +/- 6.00 HU) and CUT (78.05 +/- 8.29). The average PSNR was 28.73 +/- 0.46 decibels (dB) for cycleCUT, significantly larger than that for cycleGAN (27.96 +/- 0.49 dB) and CUT (27.95 +/- 0.69 dB). The average SSIM for cycleCUT (0.918 +/- 0.012) was also significantly higher than that for cycleGAN (0.906 +/- 0.012) and CUT (0.903 +/- 0.015). Regarding gamma analysis, cycleCUT achieved the highest passing rate (97.95 +/- 1.24% at the 2%/2 mm criteria and 10% dose threshold) but was not significantly different from the others. Conclusion The proposed cycleCUT could be effectively trained using unaligned image data, and could generate better sCT images than cycleGAN and CUT in terms of HU number accuracy and fine structural details.
引用
收藏
页数:12
相关论文
共 27 条
[1]   A new deep convolutional neural network design with efficient learning capability: Application to CT image synthesis from MRI [J].
Bahrami, Abass ;
Karimian, Alireza ;
Fatemizadeh, Emad ;
Arabi, Hossein ;
Zaidi, Habib .
MEDICAL PHYSICS, 2020, 47 (10) :5158-5171
[2]   Improving generalization in MR-to-CT synthesis in radiotherapy by using an augmented cycle generative adversarial network with unpaired data [J].
Boni, Evin N. D. Brou ;
Klein, John ;
Gulyban, Akos ;
Reynaert, Nick ;
Pasquier, David .
MEDICAL PHYSICS, 2021, 48 (06) :3003-3010
[3]   Feasibility and limitations of bulk density assignment in MRI for head and neck IMRT treatment planning [J].
Chin, Alexander L. ;
Lin, Alexander ;
Anamalayil, Shibu ;
Teo, Boon-Keng Kevin .
JOURNAL OF APPLIED CLINICAL MEDICAL PHYSICS, 2014, 15 (05) :100-111
[4]   Dosimetric characterization of MRI-only treatment planning for brain tumors in atlas-based pseudo-CT images generated from standard T1-weighted MR images [J].
Demol, Benjamin ;
Boydev, Christine ;
Korhonen, Juha ;
Reynaert, Nick .
MEDICAL PHYSICS, 2016, 43 (12) :6557-6568
[5]   An Atlas-Based Electron Density Mapping Method for Magnetic Resonance Imaging (MRI)-Alone Treatment Planning and Adaptive MRI-Based Prostate Radiation Therapy [J].
Dowling, Jason A. ;
Lambert, Jonathan ;
Parker, Joel ;
Salvado, Olivier ;
Fripp, Jurgen ;
Capp, Anne ;
Wratten, Chris ;
Denham, James W. ;
Greer, Peter B. .
INTERNATIONAL JOURNAL OF RADIATION ONCOLOGY BIOLOGY PHYSICS, 2012, 83 (01) :E5-E11
[6]   MR-based synthetic CT generation using a deep convolutional neural network method [J].
Han, Xiao .
MEDICAL PHYSICS, 2017, 44 (04) :1408-1419
[7]   Investigation of a method for generating synthetic CT models from MRI scans of the head and neck for radiation therapy [J].
Hsu, Shu-Hui ;
Cao, Yue ;
Huang, Ke ;
Feng, Mary ;
Balter, James M. .
PHYSICS IN MEDICINE AND BIOLOGY, 2013, 58 (23) :8419-8435
[8]   MRI-only brain radiotherapy: Assessing the dosimetric accuracy of synthetic CT images generated using a deep learning approach [J].
Kazemifar, Samaneh ;
McGuire, Sarah ;
Timmerman, Robert ;
Wardak, Zabi ;
Dan Nguyen ;
Park, Yang ;
Jiang, Steve ;
Owrangi, Amir .
RADIOTHERAPY AND ONCOLOGY, 2019, 136 :56-63
[9]   Comparison of Deep Learning-Based and Patch-Based Methods for Pseudo-CT Generation in MRI-Based Prostate Dose Planning [J].
Largent, Axel ;
Barateau, Anais ;
Nunes, Jean-Claude ;
Mylona, Eugenia ;
Castelli, Joel ;
Lafond, Caroline ;
Greer, Peter B. ;
Dowling, Jason A. ;
Baxter, John ;
Saint-Jalmes, Herve ;
Acosta, Oscar ;
de Crevoisier, Renaud .
INTERNATIONAL JOURNAL OF RADIATION ONCOLOGY BIOLOGY PHYSICS, 2019, 105 (05) :1137-1150
[10]   Radiotherapy treatment planning of prostate cancer using magnetic resonance imaging alone [J].
Lee, YK ;
Bollet, M ;
Charles-Edwards, G ;
Flower, MA ;
Leach, MO ;
McNair, H ;
Moore, E ;
Rowbottom, C ;
Webb, S .
RADIOTHERAPY AND ONCOLOGY, 2003, 66 (02) :203-216