Spatio-Temporal Deep Learning-Based Undersampling Artefact Reduction for 2D Radial Cine MRI With Limited Training Data

被引:65
作者
Kofler, Andreas [1 ]
Dewey, Marc [1 ,2 ]
Schaeffter, Tobias [3 ,4 ]
Wald, Christian [1 ]
Kolbitsch, Christoph [3 ,4 ]
机构
[1] Char Univ Med Berlin, Dept Radiol, D-10117 Berlin, Germany
[2] Berlin Inst Hlth, D-10178 Berlin, Germany
[3] Phys Tech Bundesanstalt, D-10587 Berlin, Germany
[4] Kings Coll London, London WC2R 2LS, England
关键词
Two dimensional displays; Magnetic resonance imaging; Image reconstruction; Image sequences; Training; Biomedical imaging; Three-dimensional displays; Deep learning; neural networks; dynamic MRI; image processing; compressed sensing; persistent homology analysis; CONVOLUTIONAL NEURAL-NETWORK; K-T FOCUSS; IMAGE-RECONSTRUCTION; COMPLEXITY; ALGORITHM; FRAMELETS; FRAMEWORK; BLAST;
D O I
10.1109/TMI.2019.2930318
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this work we reduce undersampling artefacts in two-dimensional (2D) golden-angle radial cine cardiac MRI by applying a modified version of the U-net. The network is trained on 2D spatio-temporal slices which are previously extracted from the image sequences. We compare our approach to two 2D and a 3D deep learning-based post processing methods, three iterative reconstruction methods and two recently proposed methods for dynamic cardiac MRI based on 2D and 3D cascaded networks. Our method outperforms the 2D spatially trained U-net and the 2D spatio-temporal U-net. Compared to the 3D spatio-temporal U-net, our method delivers comparable results, but requiring shorter training times and less training data. Compared to the compressed sensing-based methods kt-FOCUSS and a total variation regularized reconstruction approach, our method improves image quality with respect to all reported metrics. Further, it achieves competitive results when compared to the iterative reconstruction method based on adaptive regularization with dictionary learning and total variation and when compared to the methods based on cascaded networks, while only requiring a small fraction of the computational and training time. A persistent homology analysis demonstrates that the data manifold of the spatio-temporal domain has a lower complexity than the one of the spatial domain and therefore, the learning of a projection-like mapping is facilitated. Even when trained on only one single subject without data-augmentation, our approach yields results which are similar to the ones obtained on a large training dataset. This makes the method particularly suitable for training a network on limited training data. Finally, in contrast to the spatial 2D U-net, our proposed method is shown to be naturally robust with respect to image rotation in image space and almost achieves rotation-equivariance where neither data-augmentation nor a particular network design are required.
引用
收藏
页码:703 / 717
页数:15
相关论文
共 51 条
  • [1] Learned Primal-Dual Reconstruction
    Adler, Jonas
    Oktem, Ozan
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) : 1322 - 1332
  • [2] Solving ill-posed inverse problems using iterative deep neural networks
    Adler, Jonas
    Oktem, Ozan
    [J]. INVERSE PROBLEMS, 2017, 33 (12)
  • [3] K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation
    Aharon, Michal
    Elad, Michael
    Bruckstein, Alfred
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) : 4311 - 4322
  • [4] [Anonymous], 2013, ODL OPERATOR DISCRET
  • [5] [Anonymous], [No title captured]
  • [6] [Anonymous], 2016, Deep learning. vol
  • [7] [Anonymous], [No title captured]
  • [8] Beyond Deep Residual Learning for Image Restoration: Persistent Homology-Guided Manifold Simplification
    Bae, Woong
    Yoo, Jaejun
    Ye, Jong Chul
    [J]. 2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1141 - 1149
  • [9] On the Complexity of Neural Network Classifiers: A Comparison Between Shallow and Deep Architectures
    Bianchini, Monica
    Scarselli, Franco
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (08) : 1553 - 1565
  • [10] Undersampled radial MRI with multiple coils. Iterative image reconstruction using a total variation constraint
    Block, Kai Tobias
    Uecker, Martin
    Frahm, Jens
    [J]. MAGNETIC RESONANCE IN MEDICINE, 2007, 57 (06) : 1086 - 1098