High-Resolution 3D MRI With Deep Generative Networks via Novel Slice-Profile Transformation Super-Resolution

被引:0
作者
Lin, Jiahao [1 ,2 ]
Miao, Qi [1 ,3 ]
Surawech, Chuthaporn [1 ,4 ,5 ]
Raman, Steven S. [1 ]
Zhao, Kai [1 ]
Wu, Holden H. [1 ]
Sung, Kyunghyun [1 ]
机构
[1] Univ Calif Los Angeles, Dept Radiol Sci, Los Angeles, CA 90095 USA
[2] Univ Calif Los Angeles, Dept Elect & Comp Engn, Los Angeles, CA 90095 USA
[3] China Med Univ, Affiliated Hosp 1, Dept Radiol, Shenyang 110001, Liaoning, Peoples R China
[4] Chulalongkorn Univ, Fac Med, Dept Radiol, Bangkok 10330, Thailand
[5] King Chulalongkorn Mem Hosp, Dept Radiol, Div Diagnost Radiol, Bangkok 10330, Thailand
基金
美国国家卫生研究院;
关键词
Magnetic resonance imaging; Image resolution; Three-dimensional displays; Superresolution; Training; Image reconstruction; Generative adversarial networks; Deep learning; magnetic resonance imaging; turbo spin echo; slice profile; super-resolution; MULTI-CONTRAST SUPERRESOLUTION; VOLUME RECONSTRUCTION; FETAL; IMAGES;
D O I
10.1109/ACCESS.2023.3307577
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
High-resolution magnetic resonance imaging (MRI) sequences, such as 3D turbo or fast spin-echo (TSE/FSE) imaging, are clinically desirable but suffer from long scanning time-related blurring when reformatted into preferred orientations. Instead, multi-slice two-dimensional (2D) TSE imaging is commonly used because of its high in-plane resolution but is limited clinically by poor through-plane resolution due to elongated voxels and the inability to generate multi-planar reformations due to staircase artifacts. Therefore, multiple 2D TSE scans are acquired in various orthogonal imaging planes, increasing the overall MRI scan time. In this study, we propose a novel slice-profile transformation super-resolution (SPTSR) framework with deep generative learning for through-plane super-resolution (SR) of multi-slice 2D TSE imaging. The deep generative networks were trained by synthesized low-resolution training input via slice-profile downsampling (SP-DS), and the trained networks inferred on the slice profile convolved (SP-conv) testing input for 5.5x through-plane SR. The network output was further slice-profile deconvolved (SP-deconv) to achieve an isotropic super-resolution. Compared to SMORE SR method and the networks trained by conventional downsampling, our SPTSR framework demonstrated the best overall image quality from 50 testing cases, evaluated by two abdominal radiologists. The quantitative analysis cross-validated the expert reader study results. 3D simulation experiments confirmed the quantitative improvement of the proposed SPTSR and the effectiveness of the SP-deconv step, compared to 3D ground-truths. Ablation studies were conducted on the individual contributions of SP-DS and SP-conv, networks structure, training dataset size, and different slice profiles.
引用
收藏
页码:95022 / 95036
页数:15
相关论文
共 56 条
[1]   Deep 2D Encoder-Decoder Convolutional Neural Network for Multiple Sclerosis Lesion Segmentation in Brain MRI [J].
Aslani, Shahab ;
Dayan, Michael ;
Murino, Vittorio ;
Sona, Diego .
BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES, BRAINLES 2018, PT I, 2019, 11383 :132-141
[2]  
Bhatia KK, 2014, I S BIOMED IMAGING, P947, DOI 10.1109/ISBI.2014.6868028
[3]   Super-resolution musculoskeletal MRI using deep learning [J].
Chaudhari, Akshay S. ;
Fang, Zhongnan ;
Kogan, Feliks ;
Wood, Jeff ;
Stevens, Kathryn J. ;
Gibbons, Eric K. ;
Lee, Jin Hyung ;
Gold, Garry E. ;
Hargreaves, Brian A. .
MAGNETIC RESONANCE IN MEDICINE, 2018, 80 (05) :2139-2154
[4]  
Chen YH, 2020, Arxiv, DOI arXiv:2003.01217
[5]   Efficient and Accurate MRI Super-Resolution Using a Generative Adversarial Network and 3D Multi-level Densely Connected Network [J].
Chen, Yuhua ;
Shi, Feng ;
Christodoulou, Anthony G. ;
Xie, Yibin ;
Zhou, Zhengwei ;
Li, Debiao .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT I, 2018, 11070 :91-99
[6]  
Chen YH, 2018, I S BIOMED IMAGING, P739
[7]  
Dong J., 2021, P ADV NEUR INF PROC, P1
[8]   An automated framework for localization, segmentation and super-resolution reconstruction of fetal brain MRI [J].
Ebner, Michael ;
Wang, Guotai ;
Li, Wenqi ;
Aertsen, Michael ;
Patel, Premal A. ;
Aughwane, Rosalind ;
Melbourne, Andrew ;
Doel, Tom ;
Dymarkowski, Steven ;
De Coppi, Paolo ;
David, Anna L. ;
Deprest, Jan ;
Ourselin, Sebastien ;
Vercauteren, Tom .
NEUROIMAGE, 2020, 206
[9]   An introduction to the Fourier transform: Relationship to MRI [J].
Gallagher, Thomas A. ;
Nemeth, Alexander J. ;
Hacein-Bey, Lotfi .
AMERICAN JOURNAL OF ROENTGENOLOGY, 2008, 190 (05) :1396-1405
[10]  
Ghilezan M. J., Int. J. Radiat. Oncol. Biol. Phys.