Cinematic Rendering in Mixed-Reality Holograms: A New 3D Preoperative Planning Tool in Pediatric Heart Surgery

被引:32
作者
Gehrsitz, Pia [1 ]
Rompel, Oliver [2 ]
Schoeber, Martin [1 ]
Cesnjevar, Robert [3 ]
Purbojo, Ariawan [3 ]
Uder, Michael [2 ]
Dittrich, Sven [1 ]
Alkassar, Muhannad [1 ]
机构
[1] Friedrich Alexander Univ Erlangen Nurnberg FAU, Dept Pediat Cardiol, Univ Hosp Erlangen, Erlangen, Germany
[2] Friedrich Alexander Univ Erlangen Nurnberg FAU, Inst Radiol, Univ Hosp Erlangen, Erlangen, Germany
[3] Friedrich Alexander Univ Erlangen Nurnberg FAU, Univ Hosp Erlangen, Dept Pediat Cardiac Surg, Erlangen, Germany
来源
FRONTIERS IN CARDIOVASCULAR MEDICINE | 2021年 / 8卷
关键词
mixed-reality; cinematic rendering; 3D printing; preoperative planning; pediatric heart surgery; congenital heart disease; AUGMENTED REALITY; VIRTUAL-REALITY; MODELS;
D O I
10.3389/fcvm.2021.633611
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
Cinematic rendering (CR) is based on a new algorithm that creates a photo-realistic three-dimensional (3D) picture from cross-sectional images. Previous studies have shown its positive impact on preoperative planning. To date, CR presentation has only been possible on 2D screens which limited natural 3D perception. To depict CR-hearts spatially, we used mixed-reality technology and mapped corresponding hearts as holograms in 3D space. Our aim was to assess the benefits of CR-holograms in the preoperative planning of cardiac surgery. Including 3D prints allowed a direct comparison of two spatially resolved display methods. Twenty-six patients were recruited between February and September 2019. CT or MRI was used to visualize the patient's heart preoperatively. The surgeon was shown the anatomy in cross-sections on a 2D screen, followed by spatial representations as a 3D print and as a high-resolution hologram. The holographic representation was carried out using mixed-reality glasses (HoloLens (R)). To create the 3D prints, corresponding structures were segmented to create STL files which were printed out of resin. In 22 questions, divided in 5 categories (3D-imaging effect, representation of pathology, structure resolution, cost/benefit ratio, influence on surgery), the surgeons compared each spatial representation with the 2D method, using a five-level Likert scale. The surgical preparation time was assessed by comparing retrospectively matched patient pairs, using a paired t-test. CR-holograms surpassed 2D-monitor imaging in all categories. CR-holograms were superior to 3D prints in all categories (mean Likert scale 4.4 +/- 1.0 vs. 3.7 +/- 1.3, P < 0.05). Compared to 3D prints it especially improved the depth perception (4.7 +/- 0.7 vs. 3.7 +/- 1.2) and the representation of the pathology (4.4 +/- 0.9 vs. 3.6 +/- 1.2). 3D imaging reduced the intraoperative preparation time (n = 24, 59 +/- 23 min vs. 73 +/- 43 min, P < 0.05). In conclusion, the combination of an extremely photo-realistic presentation via cinematic rendering and the spatial presentation in 3D space via mixed-reality technology allows a previously unattained level of comprehension of anatomy and pathology in preoperative planning.
引用
收藏
页数:12
相关论文
共 29 条
  • [1] Cardiac patient-specific three-dimensional models as surgical planning tools
    Bateman, Michael G.
    Durfee, William K.
    Iles, Tinen L.
    Martin, Cindy M.
    Liao, Kenneth
    Erdman, Arthur G.
    Iaizzo, Paul A.
    [J]. SURGERY, 2020, 167 (02) : 259 - 263
  • [2] 3D-Printed Models for Surgical Planning in Complex Congenital Heart Diseases: A Systematic Review
    Batteux, Clement
    Haidar, Moussa A.
    Bonnet, Damien
    [J]. FRONTIERS IN PEDIATRICS, 2019, 7
  • [3] Mixed reality holograms for heart surgery planning: first user experience in congenital heart disease
    Brun, H.
    Bugge, R. A. B.
    Suther, L. K. R.
    Birkeland, S.
    Kumar, R.
    Pelanis, E.
    Elle, O. J.
    [J]. EUROPEAN HEART JOURNAL-CARDIOVASCULAR IMAGING, 2019, 20 (08) : 883 - 888
  • [4] Shaping the future through innovations: From medical imaging to precision medicine
    Comaniciu, Dorin
    Engel, Klaus
    Georgescu, Bogdan
    Mansi, Tommaso
    [J]. MEDICAL IMAGE ANALYSIS, 2016, 33 : 19 - 26
  • [5] Dadi G., 2014, Visualization in Engineering
  • [6] Cinematic rendering – an alternative to volume rendering for 3D computed tomography imaging
    Dappa E.
    Higashigaito K.
    Fornaro J.
    Leschka S.
    Wildermuth S.
    Alkadhi H.
    [J]. Insights into Imaging, 2016, 7 (6) : 849 - 856
  • [7] Forensic 3D Visualization of CT Data Using Cinematic Volume Rendering: A Preliminary Study
    Ebert, Lars C.
    Schweitzer, Wolf
    Gascho, Dominic
    Ruder, Thomas D.
    Flach, Patricia M.
    Thali, Michael J.
    Ampanozi, Garyfalia
    [J]. AMERICAN JOURNAL OF ROENTGENOLOGY, 2017, 208 (02) : 233 - 240
  • [8] Comparison of Cinematic Rendering and Computed Tomography for Speed and Comprehension of Surgical Anatomy
    Elshafei, Moustafa
    Binder, Johannes
    Baecker, Justus
    Brunner, Maximilian
    Uder, Michael
    Weber, Georg F.
    Gruetzmann, Robert
    Krautz, Christian
    [J]. JAMA SURGERY, 2019, 154 (08) : 738 - 744
  • [9] Fellner F., 2016, J. Biomed. Sci. Eng, V9, P170, DOI [10.4236/jbise.2016.93013, DOI 10.4236/JBISE.2016.93013]
  • [10] Advanced Medical Use of Three-Dimensional Imaging in Congenital. Heart Disease: Augmented Reality, Mixed Reality, Virtual Reality, and Three-Dimensional Printing
    Goo, Hyun Woo
    Park, Sang Joon
    Yoo, Shi-Joon
    [J]. KOREAN JOURNAL OF RADIOLOGY, 2020, 21 (02) : 133 - 145