NeSVoR: Implicit Neural Representation for Slice-to-Volume Reconstruction in MRI

被引:37
作者
Xu, Junshen [1 ]
Moyer, Daniel [2 ]
Gagoski, Borjan [3 ,4 ]
Iglesias, Juan Eugenio [5 ,6 ]
Grant, P. Ellen [3 ,4 ]
Golland, Polina [2 ]
Adalsteinsson, Elfar [1 ]
机构
[1] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02139 USA
[2] MIT, Comp Sci & Artificial Intelligence Lab CSAIL, Cambridge, MA 02139 USA
[3] Boston Childrens Hosp, Fetal Neonatal Neu roimaging & Dev Sci Ctr, Boston, MA 02115 USA
[4] Harvard Med Sch, Boston, MA 02115 USA
[5] Univ Coll London UCL, Ctr Med Image Comp, London WC1E 6BT, England
[6] Harvard Med Sch, Martinos Ctr Biomed Imaging, Boston, MA 02115 USA
基金
欧洲研究理事会;
关键词
Image reconstruction; Three-dimensional displays; Solid modeling; Magnetic resonance imaging; Encoding; Training; Biomedical imaging; MRI; slice-to-volume reconstruction; motion correction; super-resolution; 3D reconstruction; implicit neural representation; fetal brain MRI; FETAL-BRAIN MRI; MOTION CORRECTION; REGISTRATION; SUPERRESOLUTION;
D O I
10.1109/TMI.2023.3236216
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Reconstructing 3D MR volumes from multiple motion-corrupted stacks of 2D slices has shown promise in imaging of moving subjects, e. g., fetal MRI. However, existing slice-to-volume reconstruction methods are time-consuming, especially when a high-resolution volume is desired. Moreover, they are still vulnerable to severe subject motion and when image artifacts are present in acquired slices. In this work, we present NeSVoR, a resolution-agnostic slice-to-volume reconstruction method, which models the underlying volume as a continuous function of spatial coordinates with implicit neural representation. To improve robustness to subject motion and other image artifacts, we adopt a continuous and comprehensive slice acquisition model that takes into account rigid inter-slice motion, point spread function, and bias fields. NeSVoR also estimates pixel-wise and slice-wise variances of image noise and enables removal of outliers during reconstruction and visualization of uncertainty. Extensive experiments are performed on both simulated and in vivo data to evaluate the proposed method. Results show that NeSVoR achieves state-of-the-art reconstruction quality while providing two to ten-fold acceleration in reconstruction times over the state-of-the-art algorithms.
引用
收藏
页码:1707 / 1719
页数:13
相关论文
共 50 条
  • [21] Robust Super-Resolution Volume Reconstruction From Slice Acquisitions: Application to Fetal Brain MRI
    Gholipour, Ali
    Estroff, Judy A.
    Warfield, Simon K.
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2010, 29 (10) : 1739 - 1758
  • [22] IMJENSE: Scan-Specific Implicit Representation for Joint Coil Sensitivity and Image Estimation in Parallel MRI
    Feng, Ruimin
    Wu, Qing
    Feng, Jie
    She, Huajun
    Liu, Chunlei
    Zhang, Yuyao
    Wei, Hongjiang
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2024, 43 (04) : 1539 - 1553
  • [23] Implicit Neural Representation Learning for Hyperspectral Image Super-Resolution
    Zhang, Kaiwei
    Zhu, Dandan
    Min, Xiongkuo
    Zhai, Guangtao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [24] Point-Spread-Function-Aware Slice-to-Volume Registration: Application to Upper Abdominal MRI Super-Resolution
    Ebner, Michael
    Chouhan, Manil
    Patel, Premal A.
    Atkinson, David
    Amin, Zahir
    Read, Samantha
    Punwani, Shonit
    Taylor, Stuart
    Vercauteren, Tom
    Ourselin, Sebastien
    RECONSTRUCTION, SEGMENTATION, AND ANALYSIS OF MEDICAL IMAGES, 2017, 10129 : 3 - 13
  • [25] Implicit Neural Representation Learning for Hyperspectral Image Super-Resolution
    Zhang, Kaiwei
    Zhu, Dandan
    Min, Xiongkuo
    Zhai, Guangtao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [26] Super-resolution biomedical imaging via reference-free statistical implicit neural representation
    Ye, Siqi
    Shen, Liyue
    Islam, Md Tauhidul
    Xing, Lei
    PHYSICS IN MEDICINE AND BIOLOGY, 2023, 68 (20)
  • [27] Implicit Neural Networks With Fourier-Feature Inputs for Free-Breathing Cardiac MRI Reconstruction
    Kunz, Johannes F.
    Ruschke, Stefan
    Heckel, Reinhard
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2024, 10 : 1280 - 1289
  • [28] Scattered slice SHARD reconstruction for motion correction in multi-shell diffusion MRI
    Christiaens, Daan
    Cordero-Grande, Lucilio
    Pietsch, Maximilian
    Hutter, Jana
    Price, Anthony N.
    Hughes, Emer J.
    Vecchiato, Katy
    Deprez, Maria
    Edwards, A. David
    Hajnal, Joseph, V
    Tournier, J-Donald
    NEUROIMAGE, 2021, 225
  • [29] Learning Implicit Neural Representation for Satellite Object Mesh Reconstruction
    Yang, Xi
    Cao, Mengqing
    Li, Cong
    Zhao, Hua
    Yang, Dong
    REMOTE SENSING, 2023, 15 (17)
  • [30] Scanner-based real-time three-dimensional brain plus body slice-to-volume reconstruction for T2-weighted 0.55-T low-field fetal magnetic resonance imaging
    Uus, Alena
    Silva, Sara Neves
    Verdera, Jordina Aviles
    Payette, Kelly
    Hall, Megan
    Colford, Kathleen
    Luis, Aysha
    Sousa, Helena
    Ning, Zihan
    Roberts, Thomas
    Mcelroy, Sarah
    Deprez, Maria
    Hajnal, Joseph
    Rutherford, Mary
    Story, Lisa
    Hutter, Jana
    PEDIATRIC RADIOLOGY, 2025, 55 (03) : 556 - 569