Deep-learning-based reconstruction of undersampled MRI to reduce scan times: a multicentre, retrospective, cohort study

被引:15
作者
Rastogi, Aditya [1 ,2 ]
Brugnara, Gianluca [1 ,2 ]
Foltyn-Dumitru, Martha [1 ,2 ]
Mahmutoglu, Mustafa Ahmed [1 ,2 ]
Preetha, Chandrakanth J. [1 ,2 ]
Kobler, Erich [7 ]
Pflueger, Irada [1 ,2 ]
Schell, Marianne [1 ,2 ]
Deike-Hofmann, Katerina [7 ,29 ]
Kessler, Tobias [4 ,12 ]
van den Bent, Martin J. [8 ]
Idbaih, Ahmed [9 ]
Platten, Michael [10 ,11 ]
Brandes, Alba A. [13 ]
Nabors, Burt [14 ,15 ]
Stupp, Roger [16 ,17 ,18 ]
Bernhardt, Denise [19 ,20 ]
Debus, Juergen [3 ,5 ,6 ]
Abdollahi, Amir [3 ,5 ,6 ]
Gorlia, Thierry [21 ]
Tonn, Joerg-Christian [22 ,23 ]
Weller, Michael [24 ,25 ]
Maier-Hein, Klaus H. [26 ,28 ]
Radbruch, Alexander [7 ]
Wick, Wolfgang [4 ,12 ]
Bendszus, Martin [2 ]
Meredig, Hagen [1 ,2 ]
Kurz, Felix T. [27 ]
Vollmuth, Philipp [1 ,2 ,7 ,26 ]
机构
[1] Heidelberg Univ Hosp, Dept Neuroradiol, Div Computat Neuroimaging, D-69120 Heidelberg, Germany
[2] Heidelberg Univ Hosp, Dept Neuroradiol, Heidelberg, Germany
[3] Heidelberg Univ Hosp, Dept Radiat Oncol, Heidelberg, Germany
[4] Heidelberg Univ Hosp, Neurol Clin, Heidelberg, Germany
[5] Heidelberg Univ Hosp, Heidelberg Inst Radiat Oncol, Heidelberg, Germany
[6] Heidelberg Univ Hosp, Heidelberg Ion Beam Therapy Ctr, Heidelberg, Germany
[7] Univ Med Ctr Bonn, Rheinische Friedrich Wilhelms Univ Bonn, Dept Neuroradiol, Bonn, Germany
[8] Erasmus MC Canc Inst, Brain Tumor Ctr, Rotterdam, Netherlands
[9] Sorbonne Univ, Hop Pitie Salpetriere, Assistance Publ Hop Paris, Serv Neurol 1, Paris, France
[10] Heidelberg Univ, Med Fac Mannheim, Mannheim Ctr Translat Neurosci, Dept Neurol, Mannheim, Germany
[11] German Canc Res Ctr, Clin Cooperat Unit Neuroimmunol & Brain Tumor Immu, German Canc Consortium, Heidelberg, Germany
[12] German Canc Res Ctr, Clin Cooperat Unit Neurooncol, German Canc Consortium, Heidelberg, Germany
[13] Azienda Unita Sanit Locale Bologna, Dept Med Oncol, Bologna, Italy
[14] Univ Alabama Birmingham, Dept Neurol, Div Neurooncol, Birmingham, AL USA
[15] Univ Alabama Birmingham, ONeal Comprehens Canc Ctr, Birmingham, AL USA
[16] Northwestern Med & Northwestern Univ, Lou & Jean Malnati Brain Tumor Inst, Robert H Lurie Comprehens Canc Ctr, Chicago, IL USA
[17] Northwestern Med & Northwestern Univ, Dept Neurol Surg, Chicago, IL USA
[18] Northwestern Med & Northwestern Univ, Dept Neurol, Chicago, IL USA
[19] Tech Univ Munich, Sch Med, Dept Radiat Oncol, Munich, Germany
[20] Tech Univ Munich, Klinikum rechts Isar, Munich, Germany
[21] European Org Res Treatment Canc, Brussels, Belgium
[22] Ludwig Maximilians Univ Munchen, Dept Neurosurg, Munich, Germany
[23] German Ctr Res Ctr, partner site Munich, German Canc Consortium, Munich, Germany
[24] Univ Hosp, Dept Neurol, Zurich, Switzerland
[25] Univ Zurich, Zurich, Switzerland
[26] German Canc Res Ctr, Med Image Comp, Heidelberg, Germany
[27] German Canc Res Ctr, Dept Radiol, Heidelberg, Germany
[28] Heidelberg Univ Hosp, Dept Radiat Oncol, Pattern Anal & Learning Grp, Heidelberg, Germany
[29] German Ctr Neurodegenerat Dis, Bonn, Germany
关键词
NEWLY-DIAGNOSED GLIOBLASTOMA; STANDARD TREATMENT; OPEN-LABEL;
D O I
10.1016/S1470-2045(23)00641-1
中图分类号
R73 [肿瘤学];
学科分类号
100214 ;
摘要
Background The extended acquisition times required for MRI limit its availability in resource-constrained settings. Consequently, accelerating MRI by undersampling k-space data, which is necessary to reconstruct an image, has been a long-standing but important challenge. We aimed to develop a deep convolutional neural network (dCNN) optimisation method for MRI reconstruction and to reduce scan times and evaluate its effect on image quality and accuracy of oncological imaging biomarkers. Methods In this multicentre, retrospective, cohort study, MRI data from patients with glioblastoma treated at Heidelberg University Hospital (775 patients and 775 examinations) and from the phase 2 CORE trial (260 patients, 1083 examinations, and 58 institutions) and the phase 3 CENTRIC trial (505 patients, 3147 examinations, and 139 institutions) were used to develop, train, and test dCNN for reconstructing MRI from highly undersampled single-coil k-space data with various acceleration rates (R=2, 4, 6, 8, 10, and 15). Independent testing was performed with MRIs from the phase 2/3 EORTC-26101 trial (528 patients with glioblastoma, 1974 examinations, and 32 institutions). The similarity between undersampled dCNN-reconstructed and original MRIs was quantified with various image quality metrics, including structural similarity index measure (SSIM) and the accuracy of undersampled dCNN-reconstructed MRI on downstream radiological assessment of imaging biomarkers in oncology (automated artificial intelligence-based quantification of tumour burden and treatment response) was performed in the EORTC-26101 test dataset. The public NYU Langone Health fastMRI brain test dataset (558 patients and 558 examinations) was used to validate the generalisability and robustness of the dCNN for reconstructing MRIs from available multi-coil (parallel imaging) k-space data. Findings In the EORTC-26101 test dataset, the median SSIM of undersampled dCNN-reconstructed MRI ranged from 0<middle dot>88 to 0<middle dot>99 across different acceleration rates, with 0<middle dot>92 (95% CI 0<middle dot>92-0<middle dot>93) for 10-times acceleration (R=10). The 10-times undersampled dCNN-reconstructed MRI yielded excellent agreement with original MRI when assessing volumes of contrast-enhancing tumour (median DICE for spatial agreement of 0<middle dot>89 [95% CI 0<middle dot>88 to 0<middle dot>89]; median volume difference of 0<middle dot>01 cm(3) [95% CI 0<middle dot>00 to 0<middle dot>03] equalling 0<middle dot>21%; p=0<middle dot>0036 for equivalence) or non-enhancing tumour or oedema (median DICE of 0<middle dot>94 [95% CI 0<middle dot>94 to 0<middle dot>95]; median volume difference of -0<middle dot>79 cm(3) [95% CI -0<middle dot>87 to -0<middle dot>72] equalling -1<middle dot>77%; p=0<middle dot>023 for equivalence) in the EORTC-26101 test dataset. Automated volumetric tumour response assessment in the EORTC-26101 test dataset yielded an identical median time to progression of 4<middle dot>27 months (95% CI 4<middle dot>14 to 4<middle dot>57) when using 10-times-undersampled dCNN-reconstructed or original MRI (log-rank p=0<middle dot>80) and agreement in the time to progression in 374 (95<middle dot>2%) of 393 patients with data. The dCNN generalised well to the fastMRI brain dataset, with significant improvements in the median SSIM when using multi-coil compared with single-coil k-space data (p<0<middle dot>0001). Interpretation Deep-learning-based reconstruction of undersampled MRI allows for a substantial reduction of scan times, with a 10-times acceleration demonstrating excellent image quality while preserving the accuracy of derived imaging biomarkers for the assessment of oncological treatment response. Our developments are available as open source software and hold considerable promise for increasing the accessibility to MRI, pending further prospective validation.
引用
收藏
页码:400 / 410
页数:11
相关论文
共 30 条
[1]   MoDL: Model-Based Deep Learning Architecture for Inverse Problems [J].
Aggarwal, Hemant K. ;
Mani, Merry P. ;
Jacob, Mathews .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (02) :394-405
[2]  
Behl N., 2021, Deep resolve-mobilizing the power of networks
[3]   Modified Criteria for Radiographic Response Assessment in Glioblastoma Clinical Trials [J].
Ellingson, Benjamin M. ;
Wen, Patrick Y. ;
Cloughesy, Timothy F. .
NEUROTHERAPEUTICS, 2017, 14 (02) :307-320
[4]  
Hendriks J., 2021, arXiv
[5]   Medical imaging and nuclear medicine: a Lancet Oncology Commission [J].
Hricak, Hedvig ;
Abdel-Wahab, May ;
Atun, Rifat ;
Lette, Miriam Mikhail ;
Paez, Diana ;
Brink, James A. ;
Donoso-Bach, Lluis ;
Frija, Guy ;
Hierath, Monika ;
Holmberg, Ola ;
Khong, Pek-Lan ;
Lewis, Jason S. ;
McGinty, Geraldine ;
Oyen, Wim J. G. ;
Shulman, Lawrence N. ;
Ward, Zachary J. ;
Scott, Andrew M. .
LANCET ONCOLOGY, 2021, 22 (04) :E136-E172
[6]   Prostate Cancer Screening with PSA and MRI Followed by Targeted Biopsy Only [J].
Hugosson, Jonas ;
Mansson, Marianne ;
Wallstrom, Jonas ;
Axcrona, Ulrika ;
Carlsson, Sigrid V. ;
Egevad, Lars ;
Geterud, Kjell ;
Khatami, Ali ;
Kohestani, Kimia ;
Pihl, Carl-Gustaf ;
Socratous, Andreas ;
Stranne, Johan ;
Godtman, Rebecka Arnsrud ;
Hellstrom, Mikael .
NEW ENGLAND JOURNAL OF MEDICINE, 2022, 387 (23) :2126-2137
[7]   Automated quantitative tumour response assessment of MRI in neuro-oncology with artificial neural networks: a multicentre, retrospective study [J].
Kickingereder, Philipp ;
Isensee, Fabian ;
Tursunova, Irada ;
Petersen, Jens ;
Neuberger, Ulf ;
Bonekamp, David ;
Brugnara, Gianluca ;
Schell, Marianne ;
Kessler, Tobias ;
Foltyn, Martha ;
Harting, Inga ;
Sahm, Felix ;
Prager, Marcel ;
Nowosielski, Martha ;
Wick, Antje ;
Nolden, Marco ;
Radbruch, Alexander ;
Debus, Juergen ;
Schlemmer, Heinz-Peter ;
Heiland, Sabine ;
Platten, Michael ;
von Deimling, Andreas ;
van den Bent, Martin J. ;
Gorlia, Thierry ;
Wick, Wolfgang ;
Bendszus, Martin ;
Maier-Hein, Klaus H. .
LANCET ONCOLOGY, 2019, 20 (05) :728-740
[8]   Advancing machine learning for MR image reconstruction with an open competition: Overview of the 2019 fastMRI challenge [J].
Knoll, Florian ;
Murrell, Tullie ;
Sriram, Anuroop ;
Yakubova, Nafissa ;
Zbontar, Jure ;
Rabbat, Michael ;
Defazio, Aaron ;
Muckley, Matthew J. ;
Sodickson, Daniel K. ;
Zitnick, C. Lawrence ;
Recht, Michael P. .
MAGNETIC RESONANCE IN MEDICINE, 2020, 84 (06) :3054-3070
[9]   MEASUREMENT OF OBSERVER AGREEMENT FOR CATEGORICAL DATA [J].
LANDIS, JR ;
KOCH, GG .
BIOMETRICS, 1977, 33 (01) :159-174
[10]   Quantitative susceptibility mapping: Report from the 2016 reconstruction challenge [J].
Langkammer, Christian ;
Schweser, Ferdinand ;
Shmueli, Karin ;
Kames, Christian ;
Li, Xu ;
Guo, Li ;
Milovic, Carlos ;
Kim, Jinsuh ;
Wei, Hongjiang ;
Bredies, Kristian ;
Buch, Sagar ;
Guo, Yihao ;
Liu, Zhe ;
Meineke, Jakob ;
Rauscher, Alexander ;
Marques, Jose P. ;
Bilgic, Berkin .
MAGNETIC RESONANCE IN MEDICINE, 2018, 79 (03) :1661-1673