Mouse brain MR super-resolution using a deep learning network trained with optical imaging data

被引:0
作者
Liang, Zifei [1 ]
Zhang, Jiangyang [1 ]
机构
[1] NYU, Ctr Biomed Imaging, Dept Radiol, New York, NY 10012 USA
来源
FRONTIERS IN RADIOLOGY | 2023年 / 3卷
关键词
MRI; super-resolution (SR); deep learning; transfer learning; multi-modality image; RESOLUTION; IMAGES; RECONSTRUCTION;
D O I
10.3389/fradi.2023.1155866
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Introduction The resolution of magnetic resonance imaging is often limited at the millimeter level due to its inherent signal-to-noise disadvantage compared to other imaging modalities. Super-resolution (SR) of MRI data aims to enhance its resolution and diagnostic value. While deep learning-based SR has shown potential, its applications in MRI remain limited, especially for preclinical MRI, where large high-resolution MRI datasets for training are often lacking.Methods In this study, we first used high-resolution mouse brain auto-fluorescence (AF) data acquired using serial two-photon tomography (STPT) to examine the performance of deep learning-based SR for mouse brain images.Results We found that the best SR performance was obtained when the resolutions of training and target data were matched. We then applied the network trained using AF data to MRI data of the mouse brain, and found that the performance of the SR network depended on the tissue contrast presented in the MRI data. Using transfer learning and a limited set of high-resolution mouse brain MRI data, we were able to fine-tune the initial network trained using AF to enhance the resolution of MRI data.Discussion Our results suggest that deep learning SR networks trained using high-resolution data of a different modality can be applied to MRI data after transfer learning.
引用
收藏
页数:12
相关论文
共 67 条
[1]   Sub-pixel shifted acquisitions for super-resolution proton magnetic resonance spectroscopy (1H MRS) mapping [J].
Abd-Almajeed, Adnan ;
Langevin, Francois .
MAGNETIC RESONANCE IMAGING, 2015, 33 (04) :448-458
[2]   Image quality transfer and applications in diffusion MRI [J].
Alexander, Daniel C. ;
Zikic, Darko ;
Ghosh, Aurobrata ;
Tanno, Ryutaro ;
Wottschel, Viktor ;
Zhang, Jiaying ;
Kaden, Enrico ;
Dyrby, Tim B. ;
Sotiropoulos, Stamatios N. ;
Zhang, Hui ;
Criminisi, Antonio .
NEUROIMAGE, 2017, 152 :283-298
[3]   High-Performance Super-Resolution via Patch-Based Deep Neural Network for Real-Time Implementation [J].
Aoki, Reo ;
Imamura, Kousuke ;
Hirano, Akihiro ;
Matsuda, Yoshio .
IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2018, E101D (11) :2808-2817
[4]   Ultra-High-Field MR Neuroimaging [J].
Balchandani, P. ;
Naidich, T. P. .
AMERICAN JOURNAL OF NEURORADIOLOGY, 2015, 36 (07) :1204-1215
[5]   Single Image Super-ResolutionUsing Deep CNN with Dense Skip Connections and Inception-ResNet [J].
Chen, Chao ;
Qi, Feng .
2018 NINTH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY IN MEDICINE AND EDUCATION (ITME 2018), 2018, :999-1003
[6]   Sparse Representation Based Super-Resolution of MRI Images with Non-Local Total Variation Regularization [J].
Deka, Bhabesh ;
Mullah, Helal Uddin ;
Datta, Sumit ;
Lakshmi, Vijaya ;
Ganesan, Rajarajeswari .
PATTERN RECOGNITION AND MACHINE INTELLIGENCE, PREMI 2019, PT II, 2019, 11942 :78-86
[7]   Deep learning-based single image super-resolution for low-field MR brain images [J].
den Bouter, M. L. de Leeuw ;
Ippolito, G. ;
O'Reilly, T. P. A. ;
Remis, R. F. ;
van Gijzen, M. B. ;
Webb, A. G. .
SCIENTIFIC REPORTS, 2022, 12 (01)
[8]   Parameter-free image resolution estimation based on decorrelation analysis [J].
Descloux, A. ;
Grussmayer, K. S. ;
Radenovic, A. .
NATURE METHODS, 2019, 16 (09) :918-+
[9]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[10]  
Elsaid NMH, 2019, IEEE ENG MED BIO, P2830, DOI [10.1109/EMBC.2019.8857125, 10.1109/embc.2019.8857125]