Deep learning in magnetic resonance image reconstruction

被引:52
作者
Chandra, Shekhar S. [1 ]
Bran Lorenzana, Marlon [1 ]
Liu, Xinwen [1 ]
Liu, Siyu [1 ]
Bollmann, Steffen [1 ]
Crozier, Stuart [1 ]
机构
[1] Univ Queensland, Sch Informat Technol & Elect Engn, Brisbane, Qld, Australia
关键词
compressed sensing; deep learning; image reconstruction; MR imaging; parallel imaging; MULTI-CONTRAST SUPERRESOLUTION; INVERSE PROBLEMS; NEURAL-NETWORKS; MRI; TRENDS; SENSE;
D O I
10.1111/1754-9485.13276
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Magnetic resonance (MR) imaging visualises soft tissue contrast in exquisite detail without harmful ionising radiation. In this work, we provide a state-of-the-art review on the use of deep learning in MR image reconstruction from different image acquisition types involving compressed sensing techniques, parallel image acquisition and multi-contrast imaging. Publications with deep learning-based image reconstruction for MR imaging were identified from the literature (PubMed and Google Scholar), and a comprehensive description of each of the works was provided. A detailed comparison that highlights the differences, the data used and the performance of each of these works were also made. A discussion of the potential use cases for each of these methods is provided. The sparse image reconstruction methods were found to be most popular in using deep learning for improved performance, accelerating acquisitions by around 4-8 times. Multi-contrast image reconstruction methods rely on at least one pre-acquired image, but can achieve 16-fold, and even up to 32- to 50-fold acceleration depending on the set-up. Parallel imaging provides frameworks to be integrated in many of these methods for additional speed-up potential. The successful use of compressed sensing techniques and multi-contrast imaging with deep learning and parallel acquisition methods could yield significant MR acquisition speed-ups within clinical routines in the near future.
引用
收藏
页码:564 / 577
页数:14
相关论文
共 97 条
[31]   Advancing machine learning for MR image reconstruction with an open competition: Overview of the 2019 fastMRI challenge [J].
Knoll, Florian ;
Murrell, Tullie ;
Sriram, Anuroop ;
Yakubova, Nafissa ;
Zbontar, Jure ;
Rabbat, Michael ;
Defazio, Aaron ;
Muckley, Matthew J. ;
Sodickson, Daniel K. ;
Zitnick, C. Lawrence ;
Recht, Michael P. .
MAGNETIC RESONANCE IN MEDICINE, 2020, 84 (06) :3054-3070
[32]   Deep-Learning Methods for Parallel Magnetic Resonance Imaging Reconstruction: A Survey of the Current Approaches, Trends, and Issues [J].
Knoll, Florian ;
Hammernik, Kerstin ;
Zhang, Chi ;
Moeller, Steen ;
Pock, Thomas ;
Sodickson, Daniel K. ;
Akcakaya, Mehmet .
IEEE SIGNAL PROCESSING MAGAZINE, 2020, 37 (01) :128-140
[33]   Assessment of the generalization of learned image reconstruction and the potential for transfer learning [J].
Knoll, Florian ;
Hammernik, Kerstin ;
Kobler, Erich ;
Pock, Thomas ;
Recht, Michael P. ;
Sodickson, Daniel K. .
MAGNETIC RESONANCE IN MEDICINE, 2019, 81 (01) :116-128
[34]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[35]  
KULKARNI K, 2016, PROC CVPR IEEE, P449, DOI DOI 10.1109/CVPR.2016.55
[36]   CINENet: deep learning-based 3D cardiac CINE MRI reconstruction with multi-coil complex-valued 4D spatio-temporal convolutions [J].
Kustner, Thomas ;
Fuin, Niccolo ;
Hammernik, Kerstin ;
Bustin, Aurelien ;
Qi, Haikun ;
Hajhosseiny, Reza ;
Giorgio Masci, Pier ;
Neji, Radhouene ;
Rueckert, Daniel ;
Botnar, Rene M. ;
Prieto, Claudia .
SCIENTIFIC REPORTS, 2020, 10 (01)
[37]   Gradient-based learning applied to document recognition [J].
Lecun, Y ;
Bottou, L ;
Bengio, Y ;
Haffner, P .
PROCEEDINGS OF THE IEEE, 1998, 86 (11) :2278-2324
[38]   Deep Residual Learning for Accelerated MRI Using Magnitude and Phase Networks [J].
Lee, Dongwook ;
Yoo, Jaejun ;
Tak, Sungho ;
Ye, Jong Chul .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2018, 65 (09) :1985-1995
[39]  
Li ChunLong Li ChunLong, 2009, China Vegetables, P46
[40]   Deep Magnetic Resonance Image Reconstruction: Inverse Problems Meet Neural Networks [J].
Liang, Dong ;
Cheng, Jing ;
Ke, Ziwen ;
Ying, Leslie .
IEEE SIGNAL PROCESSING MAGAZINE, 2020, 37 (01) :141-151