NeSVoR: Implicit Neural Representation for Slice-to-Volume Reconstruction in MRI

被引:37
作者
Xu, Junshen [1 ]
Moyer, Daniel [2 ]
Gagoski, Borjan [3 ,4 ]
Iglesias, Juan Eugenio [5 ,6 ]
Grant, P. Ellen [3 ,4 ]
Golland, Polina [2 ]
Adalsteinsson, Elfar [1 ]
机构
[1] MIT, Dept Elect Engn & Comp Sci, Cambridge, MA 02139 USA
[2] MIT, Comp Sci & Artificial Intelligence Lab CSAIL, Cambridge, MA 02139 USA
[3] Boston Childrens Hosp, Fetal Neonatal Neu roimaging & Dev Sci Ctr, Boston, MA 02115 USA
[4] Harvard Med Sch, Boston, MA 02115 USA
[5] Univ Coll London UCL, Ctr Med Image Comp, London WC1E 6BT, England
[6] Harvard Med Sch, Martinos Ctr Biomed Imaging, Boston, MA 02115 USA
基金
欧洲研究理事会;
关键词
Image reconstruction; Three-dimensional displays; Solid modeling; Magnetic resonance imaging; Encoding; Training; Biomedical imaging; MRI; slice-to-volume reconstruction; motion correction; super-resolution; 3D reconstruction; implicit neural representation; fetal brain MRI; FETAL-BRAIN MRI; MOTION CORRECTION; REGISTRATION; SUPERRESOLUTION;
D O I
10.1109/TMI.2023.3236216
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Reconstructing 3D MR volumes from multiple motion-corrupted stacks of 2D slices has shown promise in imaging of moving subjects, e. g., fetal MRI. However, existing slice-to-volume reconstruction methods are time-consuming, especially when a high-resolution volume is desired. Moreover, they are still vulnerable to severe subject motion and when image artifacts are present in acquired slices. In this work, we present NeSVoR, a resolution-agnostic slice-to-volume reconstruction method, which models the underlying volume as a continuous function of spatial coordinates with implicit neural representation. To improve robustness to subject motion and other image artifacts, we adopt a continuous and comprehensive slice acquisition model that takes into account rigid inter-slice motion, point spread function, and bias fields. NeSVoR also estimates pixel-wise and slice-wise variances of image noise and enables removal of outliers during reconstruction and visualization of uncertainty. Extensive experiments are performed on both simulated and in vivo data to evaluate the proposed method. Results show that NeSVoR achieves state-of-the-art reconstruction quality while providing two to ten-fold acceleration in reconstruction times over the state-of-the-art algorithms.
引用
收藏
页码:1707 / 1719
页数:13
相关论文
共 50 条
  • [41] Sparse representation-based MRI super-resolution reconstruction
    Wang, Yun-Heng
    Qiao, Jiaqing
    Li, Jun-Bao
    Fu, Ping
    Chu, Shu-Chuan
    Roddick, John F.
    MEASUREMENT, 2014, 47 : 946 - 953
  • [42] Implicit neural representation for image demosaicking
    Kerepecky, Tomas
    Sroubek, Filip
    Flusser, Jan
    DIGITAL SIGNAL PROCESSING, 2025, 159
  • [43] A slice-to-volume registration method based on real-time magnetic resonance imaging for measuring three-dimensional kinematics of the knee
    Lin, Cheng-Chung
    Zhang, Shuo
    Frahm, Jens
    Lu, Tung-Wu
    Hsu, Chao-Yu
    Shih, Ting-Fang
    MEDICAL PHYSICS, 2013, 40 (10)
  • [44] MRI inter-slice reconstruction using super-resolution
    Greenspan, H
    Oz, G
    Kiryati, N
    Peled, S
    MAGNETIC RESONANCE IMAGING, 2002, 20 (05) : 437 - 446
  • [45] Geometry-Guided Neural Implicit Surface Reconstruction
    Li, Keqiang
    Wu, Huaiyu
    Zhao, Mingyang
    Fang, Qihang
    Yang, Jian
    Zhang, Ao
    Shen, Zhen
    Xiong, Gang
    Wang, Fei-Yue
    IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2024, 11 (06): : 7898 - 7908
  • [46] Shape Reconstruction of Object-Level Building From Single Image Based on Implicit Representation Network
    Zhao, Chunhui
    Zhang, Chi
    Yan, Yiming
    Su, Nan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [47] Neural implicit surface reconstruction of freehand 3D ultrasound volume with geometric constraints
    Chen, Hongbo
    Kumaralingam, Logiraj
    Zhang, Shuhang
    Song, Sheng
    Zhang, Fayi
    Zhang, Haibin
    Pham, Thanh-Tu
    Punithakumar, Kumaradevan
    Lou, Edmond H. M.
    Zhang, Yuyao
    Le, Lawrence H.
    Zheng, Rui
    MEDICAL IMAGE ANALYSIS, 2024, 98
  • [48] Thin-Slice Prostate MRI Enabled by Deep Learning Image Reconstruction
    Gassenmaier, Sebastian
    Warm, Verena
    Nickel, Dominik
    Weiland, Elisabeth
    Herrmann, Judith
    Almansour, Haidara
    Wessling, Daniel
    Afat, Saif
    CANCERS, 2023, 15 (03)
  • [49] ADAPTIVE SCAN STRATEGIES FOR FETAL MRI IMAGING USING SLICE TO VOLUME TECHNIQUES
    Kainz, Bernhard
    Malamateniou, Christina
    Ferrazzi, Giulio
    Murgasova, Maria
    Egger, Jan
    Keraudren, Kevin
    Rutherford, Mary
    Hajnal, Joseph V.
    Rueckert, Daniel
    2015 IEEE 12TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2015, : 849 - 852
  • [50] Sparse MRI reconstruction using multi-contrast image guided graph representation
    Lai, Zongying
    Qu, Xiaobo
    Lu, Hengfa
    Peng, Xi
    Guo, Di
    Yang, Yu
    Guo, Gang
    Chen, Zhong
    MAGNETIC RESONANCE IMAGING, 2017, 43 : 95 - 104