AN IMPROVED DEEP LEARNING FRAMEWORK FOR MR-TO-CT IMAGE SYNTHESIS WITH A NEW HYBRID OBJECTIVE FUNCTION

被引:11
作者
Ang, Sui Paul [1 ]
Phung, Son Lam [1 ]
Field, Matthew [2 ,3 ]
Schira, Mark Matthias [1 ]
机构
[1] Univ Wollongong, Wollongong, NSW, Australia
[2] Univ New South Wales, Sydney, NSW, Australia
[3] Ingham Inst Appl Med Res, Liverpool, Australia
来源
2022 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (IEEE ISBI 2022) | 2022年
关键词
MR-to-CT image synthesis; deep learning; GAN; structural consistency; hybrid objective function;
D O I
10.1109/ISBI52829.2022.9761546
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
There is an emerging interest in radiotherapy treatment planning that uses only magnetic resonance (MR) imaging. Current clinical workflows rely on computed tomography (CT) images for dose calculation and patient positioning, therefore synthetic CT images need to be derived from MR images. Recent efforts for MR-to-CT image synthesis have focused on unsupervised training for ease of data preparation. However, accuracy is more important than convenience. In this paper, we propose a deep learning framework for MR-to-CT image synthesis that is trained in a supervised manner. The proposed framework utilizes a new hybrid objective function to enforce visual realism, accurate electron density information, and structural consistency between the MR and CT image domains. Our experiments show that the proposed method (MAE of 68.22, PSNR of 22.28, and FID of 0.73) outperforms the existing unsupervised and supervised techniques in both quantitative and qualitative comparisons.
引用
收藏
页数:5
相关论文
共 23 条
[1]  
[Anonymous], 2015, PROC INT C LEARNING
[2]   A new deep convolutional neural network design with efficient learning capability: Application to CT image synthesis from MRI [J].
Bahrami, Abass ;
Karimian, Alireza ;
Fatemizadeh, Emad ;
Arabi, Hossein ;
Zaidi, Habib .
MEDICAL PHYSICS, 2020, 47 (10) :5158-5171
[3]   Privacy-Preserving Federated Reinforcement Learning for Popularity-Assisted Edge Caching [J].
Zheng, Chong ;
Liu, Shengheng ;
Huang, Yongming ;
Quek, Tony Q. S. .
2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
[4]   A review of substitute CT generation for MRI-only radiation therapy [J].
Edmund, Jens M. ;
Nyholm, Tufve .
RADIATION ONCOLOGY, 2017, 12
[5]  
Ge YH, 2019, I S BIOMED IMAGING, P1096, DOI [10.1109/ISBI.2019.8759529, 10.1109/isbi.2019.8759529]
[6]   MR-based synthetic CT generation using a deep convolutional neural network method [J].
Han, Xiao .
MEDICAL PHYSICS, 2017, 44 (04) :1408-1419
[7]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[8]  
Heusel M, 2017, ADV NEUR IN, V30
[9]   Image-to-Image Translation with Conditional Adversarial Networks [J].
Isola, Phillip ;
Zhu, Jun-Yan ;
Zhou, Tinghui ;
Efros, Alexei A. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5967-5976
[10]   Attention-Aware Discrimination for MR-to-CT Image Translation Using Cycle-Consistent Generative Adversarial Networks [J].
Kearney, Vasant ;
Ziemer, Benjamin P. ;
Perry, Alan ;
Wang, Tianqi ;
Chan, Jason W. ;
Ma, Lijun ;
Morin, Olivier ;
Yom, Sue S. ;
Solberg, Timothy D. .
RADIOLOGY-ARTIFICIAL INTELLIGENCE, 2020, 2 (02)