NeSVoR: Implicit Neural Representation for Slice-to-Volume Reconstruction in MRI

被引:37
作者
Xu, Junshen [1 ]
Moyer, Daniel [2 ]
Gagoski, Borjan [3 ,4 ]
Iglesias, Juan Eugenio [5 ,6 ]
Grant, P. Ellen [3 ,4 ]
Golland, Polina [2 ]
Adalsteinsson, Elfar [1 ]
机构
[1] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02139 USA
[2] MIT, Comp Sci & Artificial Intelligence Lab CSAIL, Cambridge, MA 02139 USA
[3] Boston Childrens Hosp, Fetal Neonatal Neu roimaging & Dev Sci Ctr, Boston, MA 02115 USA
[4] Harvard Med Sch, Boston, MA 02115 USA
[5] Univ Coll London UCL, Ctr Med Image Comp, London WC1E 6BT, England
[6] Harvard Med Sch, Martinos Ctr Biomed Imaging, Boston, MA 02115 USA
基金
欧洲研究理事会;
关键词
Image reconstruction; Three-dimensional displays; Solid modeling; Magnetic resonance imaging; Encoding; Training; Biomedical imaging; MRI; slice-to-volume reconstruction; motion correction; super-resolution; 3D reconstruction; implicit neural representation; fetal brain MRI; FETAL-BRAIN MRI; MOTION CORRECTION; REGISTRATION; SUPERRESOLUTION;
D O I
10.1109/TMI.2023.3236216
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Reconstructing 3D MR volumes from multiple motion-corrupted stacks of 2D slices has shown promise in imaging of moving subjects, e. g., fetal MRI. However, existing slice-to-volume reconstruction methods are time-consuming, especially when a high-resolution volume is desired. Moreover, they are still vulnerable to severe subject motion and when image artifacts are present in acquired slices. In this work, we present NeSVoR, a resolution-agnostic slice-to-volume reconstruction method, which models the underlying volume as a continuous function of spatial coordinates with implicit neural representation. To improve robustness to subject motion and other image artifacts, we adopt a continuous and comprehensive slice acquisition model that takes into account rigid inter-slice motion, point spread function, and bias fields. NeSVoR also estimates pixel-wise and slice-wise variances of image noise and enables removal of outliers during reconstruction and visualization of uncertainty. Extensive experiments are performed on both simulated and in vivo data to evaluate the proposed method. Results show that NeSVoR achieves state-of-the-art reconstruction quality while providing two to ten-fold acceleration in reconstruction times over the state-of-the-art algorithms.
引用
收藏
页码:1707 / 1719
页数:13
相关论文
共 50 条
  • [1] Deformable Slice-to-Volume Registration for Motion Correction of Fetal Body and Placenta MRI
    Uus, Alena
    Zhang, Tong
    Jackson, Laurence H.
    Roberts, Thomas A.
    Rutherford, Mary A.
    Hajnal, Joseph, V
    Deprez, Maria
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (09) : 2750 - 2759
  • [2] Fully Convolutional Slice-to-Volume Reconstruction for Single-Stack MRI
    Young, Sean, I
    Balbastre, Yael
    Fischl, Bruce
    Golland, Polina
    Iglesias, Juan Eugenio
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 11535 - 11545
  • [3] SVoRT: Iterative Transformer for Slice-to-Volume Registration in Fetal Brain MRI
    Xu, Junshen
    Moyer, Daniel
    Grant, P. Ellen
    Golland, Polina
    Iglesias, Juan Eugenio
    Adalsteinsson, Elfar
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VI, 2022, 13436 : 3 - 13
  • [4] Fetal MRI Reconstruction by Global Diffusion and Consistent Implicit Representation
    Tan, Junpeng
    Zhang, Xin
    Qing, Chunmei
    Yang, Chaoxiang
    Zhang, He
    Li, Gang
    Xu, Xiangmin
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT VII, 2024, 15007 : 329 - 339
  • [5] Deformable Slice-to-Volume Registration for Reconstruction of Quantitative T2*Placental and Fetal MRI
    Uus, Alena
    Steinweg, Johannes K.
    Ho, Alison
    Jackson, Laurence H.
    Hajnal, Joseph V.
    Rutherford, Mary A.
    Deprez, Maria
    Hutter, Jana
    MEDICAL ULTRASOUND, AND PRETERM, PERINATAL AND PAEDIATRIC IMAGE ANALYSIS, ASMUS 2020, PIPPI 2020, 2020, 12437 : 222 - 232
  • [6] A Novel Implicit Neural Representation for Volume Data
    Sheibanifard, Armin
    Yu, Hongchuan
    APPLIED SCIENCES-BASEL, 2023, 13 (05):
  • [7] NeRP: Implicit Neural Representation Learning With Prior Embedding for Sparsely Sampled Image Reconstruction
    Shen, Liyue
    Pauly, John
    Xing, Lei
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (01) : 770 - 782
  • [8] An Arbitrary Scale Super-Resolution Approach for 3D MR Images via Implicit Neural Representation
    Wu, Qing
    Li, Yuwei
    Sun, Yawen
    Zhou, Yan
    Wei, Hongjiang
    Yu, Jingyi
    Zhang, Yuyao
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (02) : 1004 - 1015
  • [9] Accurate Prenatal Diagnosis of Cleft Palate Using Magnetic Resonance Imaging with Slice-to-Volume Reconstruction
    Yuan, Wei
    Deng, Zhixian
    Peng, Xuhong
    Guan, Xiuhong
    Mao, Huan
    Song, Ting
    Xie, Guoxi
    APPLIED MAGNETIC RESONANCE, 2020, 51 (01) : 23 - 32
  • [10] Slice-to-Volume Registration Enables Automated Pancreas MRI Quantification in UK Biobank
    Bagur, Alexandre Triay
    Aljabar, Paul
    Arya, Zobair
    McGonigle, John
    Brady, Sir Michael
    Bulte, Daniel
    MEDICAL IMAGE UNDERSTANDING AND ANALYSIS (MIUA 2021), 2021, 12722 : 210 - 223