3D Reconstructions of Brain from MRI Scans Using Neural Radiance Fields

被引:3
作者
Iddrisu, Khadija [1 ]
Malec, Sylwia [2 ]
Crimi, Alessandro [2 ]
机构
[1] African Inst Math Sci, Cape Town, South Africa
[2] Sano Ctr Computat Med, Krakow, Poland
来源
ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2023, PT II | 2023年 / 14126卷
关键词
3D reconstruction; MRI scans; Neural radiance fields; Structure from motion;
D O I
10.1007/978-3-031-42508-0_19
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The advent of 3D Magnetic Resonance Imaging (MRI) has revolutionized medical imaging and diagnostic capabilities, allowing for more precise diagnosis, treatment planning, and improved patient outcomes. 3D MRI imaging enables the creation of detailed 3D reconstructions of anatomical structures that can be used for visualization, analysis, and surgical planning. However, these reconstructions often require many scan acquisitions, demanding a long session to use the machine and requiring the patient to remain still, with consequent possible motion artifacts. The development of neural radiance fields (NeRF) technology has shown promising results in generating highly accurate 3D reconstructions of MRI images with less user input. Our approach is based on neural radiance fields to reconstruct 3D projections from 2D slices of MRI scans. We do this by using 3D convolutional neural networks to address challenges posed by variable slice thickness; incorporating multiple MRI modalities to ensure robustness and extracting the shape and volumetric depth of both surface and internal anatomical structures with slice interpolation. This approach provides more comprehensive and robust 3D reconstructions of both surface and internal anatomical structures and has significant potential for clinical applications, allowing medical professionals to better visualize and analyze anatomical structures with less available data, potentially reducing times and motion-related issues.
引用
收藏
页码:207 / 218
页数:12
相关论文
共 15 条
[1]   MedNeRF: Medical Neural Radiance Fields for Reconstructing 3D-aware CT-Projections from a Single X-ray [J].
Corona-Figueroa, Abril ;
Frawley, Jonathan ;
Bond-Taylor, Sam ;
Bethapudi, Sarath ;
Shum, Hubert P. H. ;
Willcocks, Chris G. .
2022 44TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY, EMBC, 2022, :3843-3848
[2]   Motion correction in MRI of the brain [J].
Godenschweger, F. ;
Kaegebein, U. ;
Stucht, D. ;
Yarach, U. ;
Sciarra, A. ;
Yakupov, R. ;
Luesebrink, F. ;
Schulze, P. ;
Speck, O. .
PHYSICS IN MEDICINE AND BIOLOGY, 2016, 61 (05) :R32-R56
[3]  
Han D., 2013, Proceedings of the 2nd International Conference on Computer Science and Electronics Engineering (ICCSEE 2013), P1556, DOI [10.2991/iccsee.2013.391, 10.2991/iccsee.2013.391.2]
[4]   Research on 3D medical image surface reconstruction based on data mining and machine learning [J].
Hua, Shanshan ;
Liu, Qi ;
Yin, Guanxiang ;
Guan, Xiaohui ;
Jiang, Nan ;
Zhang, Yuejin .
INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2022, 37 (08) :4654-4669
[5]   Slice Interpolation in MRI Using a Decomposition-reconstruction Method [J].
Lin, Qinghua ;
Zhang, Qin ;
Li Tongbin .
2017 4TH INTERNATIONAL CONFERENCE ON INFORMATION SCIENCE AND CONTROL ENGINEERING (ICISCE), 2017, :678-681
[6]  
Long Y., 2022, Comput. Methods Biomech. Biomed. Eng. Imaging Visual., P1
[7]   2D-to-3D: A Review for Computational 3D Image Reconstruction from X-ray Images [J].
Maken, Payal ;
Gupta, Abhishek .
ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING, 2023, 30 (01) :85-114
[8]   Novel View Synthesis for Surgical Recording [J].
Masuda, Mana ;
Saito, Hideo ;
Takatsume, Yoshifumi ;
Kajita, Hiroki .
DEEP GENERATIVE MODELS, DGM4MICCAI 2022, 2022, 13609 :67-76
[9]  
Mildenhall B, 2022, COMMUN ACM, V65, P99, DOI 10.1145/3503250
[10]   D-NeRF: Neural Radiance Fields for Dynamic Scenes [J].
Pumarola, Albert ;
Corona, Enric ;
Pons-Moll, Gerard ;
Moreno-Noguer, Francesc .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :10313-10322