An innovative mixed reality approach for maxillofacial osteotomies and repositioning

被引:8
作者
Brunzini, Agnese [1 ]
Mazzoli, Alida [2 ]
Pagnoni, Mario [3 ]
Mandolini, Marco [1 ]
机构
[1] Univ Politecn Marche, Dept Ind Engn & Math Sci, Via Brecce Bianche 12, I-60131 Ancona, Italy
[2] Univ Politecn Marche, Dept Mat Environm Sci & Urban Planning, Via Brecce Bianche 12, Ancona 60131, Italy
[3] YourFACE, Clin Ars Biomed, Via Luigi Bodio 58, I-00191 Rome, Italy
关键词
Maxillofacial surgery; Mixed reality; Augmented reality; Hololens; Surgical guide; AUGMENTED REALITY; SURGERY; HOLOLENS;
D O I
10.1007/s10055-023-00867-z
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Craniomaxillofacial surgeries are performed using custom-made physical cutting guides and resin dental splints that present several drawbacks (e.g. time and cost required for their design and production). The literature commonly provides augmented/mixed reality (AR/MR) solutions for assisting maxillofacial osteotomies and repositioning without any interactive guide. This work proposes a new MR application, useful for osteotomy and repositioning, providing interactive, fast, and intuitive feedback to the surgeon, who is then supported in performing the bone fragment resection and replacement frame by frame. The proposed application speeds up the surgery and reduces under/overshooting errors. Moreover, the idea of integrating osteotomy and repositioning assistance in the same MR application is rarely found in the literature. It is an entirely novel approach to craniomaxillofacial surgery. The MR application has been designed with a three-button menu. The "App Start" calibrates the app, the "Osteotomy Mode" visualises the holograms of the cutting lines and drilling points, and the "Repositioning Mode" visualises the step-by-step real-time feedback to precisely support the surgeon placing the osteotomised bone fragment towards the final pre-planned position. The MR app has been developed in Unity and deployed on Microsoft HoloLens V2. A laboratory test bench was realised to validate the accuracy of the proposed MR-based approach. The validation protocol consists of two tasks to test the osteotomy and repositioning modes using a 3D-printed skull phantom. For osteotomy, the accuracy is 0.89 mm (genioplasty), 1.24 mm (maxillary osteotomy), 1.33 mm (orthognathic surgery), and 2.89 mm (mandibular angle osteotomy). For repositioning, the accuracy is 0.6 mm (anteroposterior deviation), 0.7 mm (mediolateral deviation), and 0.6 degrees (angular deviation).
引用
收藏
页码:3221 / 3237
页数:17
相关论文
共 40 条
[1]   Augmented Reality Based Surgical Navigation of Complex Pelvic Osteotomies-A Feasibility Study on Cadavers [J].
Ackermann, Joelle ;
Liebmann, Florentin ;
Hoch, Armando ;
Snedeker, Jess G. ;
Farshad, Mazda ;
Rahm, Stefan ;
Zingg, Patrick O. ;
Furnstahl, Philipp .
APPLIED SCIENCES-BASEL, 2021, 11 (03) :1-19
[2]  
Afif FN., 2013, International Journal of Interactive Digital Media, V1, P46
[3]   Registration Techniques for Clinical Applications of Three-Dimensional Augmented Reality Devices [J].
Andrews, Christopher M. ;
Henry, Alexander B. ;
Soriano, Ignacio M. ;
Southworth, Michael K. ;
Silva, Jonathan R. .
IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE, 2021, 9
[4]   A survey of augmented reality [J].
Azuma, RT .
PRESENCE-VIRTUAL AND AUGMENTED REALITY, 1997, 6 (04) :355-385
[5]   Review on Augmented Reality in Oral and Cranio-Maxillofacial Surgery: Toward "Surgery-Specific" Head-Up Displays [J].
Badiali, Giovanni ;
Cercenelli, Laura ;
Battaglia, Salvatore ;
Marcelli, Emanuela ;
Marchetti, Claudio ;
Ferrari, Vincenzo ;
Cutolo, Fabrizio .
IEEE ACCESS, 2020, 8 :59015-59028
[6]   Multimodal markers for technology-independent integration of augmented reality devices and surgical navigation systems [J].
Benmahdjoub, Mohamed ;
Niessen, Wiro J. ;
Wolvius, Eppo B. ;
van Walsum, Theo .
VIRTUAL REALITY, 2022, 26 (04) :1637-1650
[7]   HoloLens 2 for Maxillofacial Surgery: A Preliminary Study [J].
Brunzini, Agnese ;
Mandolini, Marco ;
Caragiuli, Manila ;
Germani, Michele ;
Mazzoli, Alida ;
Pagnoni, Mario .
DESIGN TOOLS AND METHODS IN INDUSTRIAL ENGINEERING II, ADM 2021, 2022, :133-140
[8]   A comprehensive method to design and assess mixed reality simulations [J].
Brunzini, Agnese ;
Papetti, Alessandra ;
Messi, Daniele ;
Germani, Michele .
VIRTUAL REALITY, 2022, 26 (04) :1257-1275
[9]   Application of Augmented Reality to Maxillary Resections: A Three-Dimensional Approach to Maxillofacial Oncologic Surgery [J].
Ceccariglia, Francesco ;
Cercenelli, Laura ;
Badiali, Giovanni ;
Marcelli, Emanuela ;
Tarsitano, Achille .
JOURNAL OF PERSONALIZED MEDICINE, 2022, 12 (12)
[10]  
Cortese A, 2012, ROLE OF OSTEOTOMY IN THE CORRECTION OF CONGENITAL AND ACQUIRED DISORDERS OF THE SKELETON, P23