3D Reconstructions of Brain from MRI Scans Using Neural Radiance Fields

被引:2
|
作者
Iddrisu, Khadija [1 ]
Malec, Sylwia [2 ]
Crimi, Alessandro [2 ]
机构
[1] African Inst Math Sci, Cape Town, South Africa
[2] Sano Ctr Computat Med, Krakow, Poland
关键词
3D reconstruction; MRI scans; Neural radiance fields; Structure from motion;
D O I
10.1007/978-3-031-42508-0_19
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The advent of 3D Magnetic Resonance Imaging (MRI) has revolutionized medical imaging and diagnostic capabilities, allowing for more precise diagnosis, treatment planning, and improved patient outcomes. 3D MRI imaging enables the creation of detailed 3D reconstructions of anatomical structures that can be used for visualization, analysis, and surgical planning. However, these reconstructions often require many scan acquisitions, demanding a long session to use the machine and requiring the patient to remain still, with consequent possible motion artifacts. The development of neural radiance fields (NeRF) technology has shown promising results in generating highly accurate 3D reconstructions of MRI images with less user input. Our approach is based on neural radiance fields to reconstruct 3D projections from 2D slices of MRI scans. We do this by using 3D convolutional neural networks to address challenges posed by variable slice thickness; incorporating multiple MRI modalities to ensure robustness and extracting the shape and volumetric depth of both surface and internal anatomical structures with slice interpolation. This approach provides more comprehensive and robust 3D reconstructions of both surface and internal anatomical structures and has significant potential for clinical applications, allowing medical professionals to better visualize and analyze anatomical structures with less available data, potentially reducing times and motion-related issues.
引用
收藏
页码:207 / 218
页数:12
相关论文
共 50 条
  • [1] Volumetric Segmentation of Brain Regions From MRI Scans Using 3D Convolutional Neural Networks
    Ramzan, Farheen
    Khan, Muhammad Usman Ghani
    Iqbal, Sajid
    Saba, Tanzila
    Rehman, Amjad
    IEEE ACCESS, 2020, 8 : 103697 - 103709
  • [2] Isotropic Brain MRI Reconstruction from Orthogonal Scans Using 3D Convolutional Neural Network
    Tian, Jinsha
    Xiao, Canjun
    Zhu, Hongjin
    SENSORS, 2024, 24 (20)
  • [3] Brain Tumor Segmentation from 3D MRI Scans Using U-Net
    Montaha S.
    Azam S.
    Rakibul Haque Rafid A.K.M.
    Hasan M.Z.
    Karim A.
    SN Computer Science, 4 (4)
  • [4] The Potential of Neural Radiance Fields and 3D Gaussian Splatting for 3D Reconstruction from Aerial Imagery
    Haitz, Dennis
    Hermann, Max
    Roth, Aglaja Solana
    Weinmann, Michael
    Weinmann, Martin
    ISPRS ANNALS OF THE PHOTOGRAMMETRY, REMOTE SENSING AND SPATIAL INFORMATION SCIENCES: VOLUME X-2-2024, 2024, : 97 - 104
  • [5] SuNeRF: 3D Reconstruction of the Solar EUV Corona Using Neural Radiance Fields
    Jarolim, Robert
    Tremblay, Benoit
    Munoz-Jaramillo, Andres
    Bintsi, Kyriaki-Margarita
    Jungbluth, Anna
    Santos, Miraflor
    Vourlidas, Angelos
    Mason, James P.
    Sundaresan, Sairam
    Downs, Cooper
    Caplan, Ronald M.
    ASTROPHYSICAL JOURNAL LETTERS, 2024, 961 (02)
  • [6] High-fidelity 3D reconstruction of plants using Neural Radiance Fields
    Hu, Kewei
    Ying, Wei
    Pan, Yaoqiang
    Kang, Hanwen
    Chen, Chao
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2024, 220
  • [7] Segmentation of MRI brain scans using spatial constraints and 3D features
    Grande-Barreto, Jonas
    Gomez-Gil, Pilar
    MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2020, 58 (12) : 3101 - 3112
  • [8] Segmentation of MRI brain scans using spatial constraints and 3D features
    Jonas Grande-Barreto
    Pilar Gómez-Gil
    Medical & Biological Engineering & Computing, 2020, 58 : 3101 - 3112
  • [9] DEFORMTOON3D: Deformable Neural Radiance Fields for 3D Toonification
    Zhang, Junzhe
    Lan, Yushi
    Yang, Shuai
    Hong, Fangzhou
    Wang, Quan
    Yeo, Chai Kiat
    Liu, Ziwei
    Loy, Chen Change
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 9110 - 9120
  • [10] 3D reconstructions from spectral light fields
    Farber, Vladimir
    Oiknine, Yaniv
    August, Isaac
    Stern, Adrian
    THREE-DIMENSIONAL IMAGING, VISUALIZATION, AND DISPLAY 2018, 2018, 10666