Attention-Aware Discrimination for MR-to-CT Image Translation Using Cycle-Consistent Generative Adversarial Networks

被引:60
作者
Kearney, Vasant [1 ]
Ziemer, Benjamin P. [1 ]
Perry, Alan [1 ]
Wang, Tianqi [1 ]
Chan, Jason W. [1 ]
Ma, Lijun [1 ]
Morin, Olivier [1 ]
Yom, Sue S. [1 ]
Solberg, Timothy D. [1 ]
机构
[1] Univ Calif San Francisco, Dept Radiat Oncol, 1600 Divisidero St, San Francisco, CA 94115 USA
关键词
OPTIMIZATION; ALGORITHM;
D O I
10.1148/ryai.2020190027
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Purpose: To suggest an attention-aware, cycle-consistent generative adversarial network (A-CycleGAN) enhanced with variational auto-encoding (VAE) as a superior alternative to current state-of-the-art MR-to-CT image translation methods. Materials and Methods: An attention-gating mechanism is incorporated into a discriminator network to encourage a more parsimonious use of network parameters, whereas VAE enhancement enables deeper discrimination architectures without inhibiting model convergence. Findings from 60 patients with head, neck, and brain cancer were used to train and validate A-CycleGAN, and findings from 30 patients were used for the holdout test set and were used to report final evaluation metric results using mean absolute error (MAE) and peak signal-to-noise ratio (PSNR). Results: A-CycleGAN achieved superior results compared with U-Net, a generative adversarial network (GAN), and a cycle-consistent GAN. The A-CycleGAN averages, 95% confidence intervals (CIs), and Wilcoxon signed-rank two-sided test statistics are shown for MAE (19.61 [95% CI: 18.83, 20.39], P = .0104), structure similarity index metric (0.778 [95% CI: 0.758, 0.798], P = .0495), and PSNR (62.35 [95% CI: 61.80, 62.90], P = .0571). Conclusion: A-CycleGANs were a superior alternative to state-of-the-art MR-to-CT image translation methods. (c) RSNA, 2020
引用
收藏
页数:7
相关论文
共 38 条
[1]  
Batra D., 2019, IEEE I CONF COMP VIS
[2]   A convolutional neural network algorithm for automatic segmentation of head and neck organs at risk using deep lifelong learning [J].
Chan, Jason W. ;
Kearney, Vasant ;
Haaf, Samuel ;
Wu, Susan ;
Bogdanov, Madeleine ;
Reddick, Mariah ;
Dixit, Nayha ;
Sudhyadhom, Atchar ;
Chen, Josephine ;
Yom, Sue S. ;
Solberg, Timothy D. .
MEDICAL PHYSICS, 2019, 46 (05) :2204-2213
[3]   The magnetic resonance detected intraprostatic lesion in prostate cancer: planning and delivery of intensity-modulated radiotherapy [J].
De Meerleer, G ;
Villeirs, G ;
Bral, S ;
Paelinck, L ;
De Gersem, W ;
Dekuyper, P ;
De Neve, W .
RADIOTHERAPY AND ONCOLOGY, 2005, 75 (03) :325-333
[4]  
Doersch C., ARXIV 160605908 PREP
[5]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[6]   MR-based synthetic CT generation using a deep convolutional neural network method [J].
Han, Xiao .
MEDICAL PHYSICS, 2017, 44 (04) :1408-1419
[7]   Deep nets vs expert designed features in medical physics: An IMRT QA case study [J].
Interian, Yannet ;
Rideout, Vincent ;
Kearney, Vasant P. ;
Gennatas, Efstathios ;
Morin, Olivier ;
Cheung, Joey ;
Solberg, Timothy ;
Valdes, Gilmer .
MEDICAL PHYSICS, 2018, 45 (06) :2672-2680
[8]  
Isola P, ARXIV 161107004
[9]  
Januszewski M., 2019, bioRxiv, DOI [DOI 10.1101/548081, 10.1101/548081]
[10]   A finite size pencil beam algorithm for IMRT dose optimization: density corrections [J].
Jelen, U. ;
Alber, M. .
PHYSICS IN MEDICINE AND BIOLOGY, 2007, 52 (03) :617-633