SMORE: A Self-Supervised Anti-Aliasing and Super-Resolution Algorithm for MRI Using Deep Learning

被引:105
作者
Zhao, Can [1 ]
Dewey, Blake E. [1 ,2 ]
Pham, Dzung L. [3 ]
Calabresi, Peter A. [4 ]
Reich, Daniel S. [5 ]
Prince, Jerry L. [1 ]
机构
[1] Johns Hopkins Univ, Dept Elect & Comp Engn, Baltimore, MD 21218 USA
[2] Kennedy Krieger Inst, Kirby Ctr Funct Brain Imaging Res, Baltimore, MD 21205 USA
[3] Henry M Jackson Fdn, Ctr Neurosci & Regenerat Med, Bethesda, MD 20817 USA
[4] Johns Hopkins Sch Med, Dept Neurol, Baltimore, MD 21205 USA
[5] NINDS, Translat Neuroradiol Sect, NIH, Bldg 36,Rm 4D04, Bethesda, MD 20892 USA
关键词
Magnetic resonance imaging; Three-dimensional displays; Two dimensional displays; Training data; Protocols; self-supervised; super-resolution; deep network; magnetic resonance imaging; convolutional neural network; anti-aliasing;
D O I
10.1109/TMI.2020.3037187
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
High resolution magnetic resonance (MR) images are desired in many clinical and research applications. Acquiring such images with high signal-to-noise (SNR), however, can require a long scan duration, which is difficult for patient comfort, is more costly, and makes the images susceptible to motion artifacts. A very common practical compromise for both 2D and 3D MR imaging protocols is to acquire volumetric MR images with high in-plane resolution, but lower through-plane resolution. In addition to having poor resolution in one orientation, 2D MRI acquisitions will also have aliasing artifacts, which further degrade the appearance of these images. This paper presents an approach SMORE1 based on convolutional neural networks (CNNs) that restores image quality by improving resolution and reducing aliasing in MR images.(2) This approach is self-supervised, which requires no external training data because the high-resolution and low-resolution data that are present in the image itself are used for training. For 3D MRI, the method consists of only one self-supervised super-resolution (SSR) deep CNN that is trained from the volumetric image data. For 2D MRI, there is a self-supervised anti-aliasing (SAA) deep CNN that precedes the SSR CNN, also trained from the volumetric image data. Both methods were evaluated on a broad collection of MR data, including filtered and downsampled images so that quantitative metrics could be computed and compared, and actual acquired low resolution images for which visual and sharpness measures could be computed and compared. The super-resolution method is shown to be visually and quantitatively superior to previously reported methods.
引用
收藏
页码:805 / 817
页数:13
相关论文
共 46 条
[1]  
Alexander DC, 2014, LECT NOTES COMPUT SC, V8675, P225, DOI 10.1007/978-3-319-10443-0_29
[2]  
[Anonymous], 2018, ARXIV180907517
[3]   The Holy Grail in diagnostic neuroradiology: 3T or 3D? [J].
Barkhof, Frederik ;
Pouwels, Petra J. W. ;
Wattjes, Mike P. .
EUROPEAN RADIOLOGY, 2011, 21 (03) :449-456
[4]   Effect of windowing and zero-filled reconstruction of MRI data on spatial resolution and acquisition strategy [J].
Bernstein, MA ;
Fain, SB ;
Riederer, SJ .
JOURNAL OF MAGNETIC RESONANCE IMAGING, 2001, 14 (03) :270-280
[5]  
Chen YH, 2018, I S BIOMED IMAGING, P739
[6]   Collaborative patch-based super-resolution for diffusion-weighted images [J].
Coupe, Pierrick ;
Manjon, Jose V. ;
Chamberland, Maxime ;
Descoteaux, Maxine ;
Hiba, Bassem .
NEUROIMAGE, 2013, 83 :245-261
[7]   Medical Image Imputation From Image Collections [J].
Dalca, Adrian V. ;
Bouman, Katherine L. ;
Freeman, William T. ;
Rost, Natalia S. ;
Sabuncu, Mert R. ;
Golland, Polina ;
Weiner, Michael W. ;
Aisen, Paul ;
Weiner, Michael ;
Aisen, Paul ;
Petersen, Ronald ;
Jack, Clifford R., Jr. ;
Jagust, William ;
Trojanowki, John Q. ;
Toga, Arthur W. ;
Beckett, Laurel ;
Green, Robert C. ;
Saykin, Andrew J. ;
Morris, John ;
Shaw, Leslie M. ;
Khachaturian, Zaven ;
Sorensen, Greg ;
Carrillo, Maria ;
Kuller, Lew ;
Raichle, Marc ;
Paul, Steven ;
Davies, Peter ;
Fillit, Howard ;
Hefti, Franz ;
Holtzman, David ;
Mesulam, M. Marcel ;
Potter, William ;
Snyder, Peter ;
Lilly, Eli ;
Logovinsky, Veronika ;
Green, Robert C. ;
Montine, Tom ;
Petersen, Ronald ;
Aisen, Paul ;
Jimenez, Gustavo ;
Donohue, Michael ;
Gessert, Devon ;
Harless, Kelly ;
Salazar, Jennifer ;
Cabrera, Yuliana ;
Walter, Sarah ;
Hergesheimer, Lindsey ;
Beckett, Laurel ;
Harvey, Danielle ;
Donohue, Michael .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (02) :504-514
[8]   Population Based Image Imputation [J].
Dalca, Adrian V. ;
Bouman, Katherine L. ;
Freeman, William T. ;
Rost, Natalia S. ;
Sabuncu, Mert R. ;
Golland, Polina .
INFORMATION PROCESSING IN MEDICAL IMAGING (IPMI 2017), 2017, 10265 :659-671
[9]   Hand-Held Video Deblurring Via Efficient Fourier Aggregation [J].
Delbracio, Mauricio ;
Sapiro, Guillermo .
IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2015, 1 (04) :270-283
[10]   Super-resolution reconstruction of single anisotropic 3D MR images using residual convolutional neural network [J].
Du, Jinglong ;
He, Zhongshi ;
Wang, Lulu ;
Gholipour, Ali ;
Zhou, Zexun ;
Chen, Dingding ;
Jia, Yuanyuan .
NEUROCOMPUTING, 2020, 392 :209-220