Development and Application of Digital Maxillofacial Surgery System Based on Mixed Reality Technology

被引:13
|
作者
Yang, Rong [1 ]
Li, Chenyao [1 ]
Tu, Puxun [2 ]
Ahmed, Abdelrehem [3 ]
Ji, Tong [1 ]
Chen, Xiaojun [2 ]
机构
[1] Shanghai Jiao Tong Univ, Peoples Hosp 9,Shanghai Key Lab Stomatol, Natl Clin Res Ctr Oral Dis,Shanghai Inst Stomatol, Sch Med,Dept Oral & Maxillofacial Head & Neck Onc, Shanghai, Peoples R China
[2] Shanghai Jiao Tong Univ, Sch Mech & Engn, Shanghai, Peoples R China
[3] Alexandria Univ, Fac Dent, Dept Craniomaxillofacial & Plast Surg, Alexandria, Egypt
来源
FRONTIERS IN SURGERY | 2022年 / 8卷
关键词
maxillofacial surgery; digital surgery; surgical navigation; mixed reality; three-dimensional visual output; SURGICAL NAVIGATION; AUGMENTED REALITY; HOLOLENS; PLACEMENT; DEVICE;
D O I
10.3389/fsurg.2021.719985
中图分类号
R61 [外科手术学];
学科分类号
摘要
ObjectiveTo realize the three-dimensional visual output of surgical navigation information by studying the cross-linking of mixed reality display devices and high-precision optical navigators. MethodsApplying quaternion-based point alignment algorithms to realize the positioning configuration of mixed reality display devices, high-precision optical navigators, real-time patient tracking and calibration technology; based on open source SDK and development tools, developing mixed reality surgery based on visual positioning and tracking system. In this study, four patients were selected for mixed reality-assisted tumor resection and reconstruction and re-examined 1 month after the operation. We reconstructed postoperative CT and use 3DMeshMetric to form the error distribution map, and completed the error analysis and quality control. ResultsRealized the cross-linking of mixed reality display equipment and high-precision optical navigator, developed a digital maxillofacial surgery system based on mixed reality technology and successfully implemented mixed reality-assisted tumor resection and reconstruction in 4 cases. ConclusionsThe maxillofacial digital surgery system based on mixed reality technology can superimpose and display three-dimensional navigation information in the surgeon's field of vision. Moreover, it solves the problem of visual conversion and space conversion of the existing navigation system. It improves the work efficiency of digitally assisted surgery, effectively reduces the surgeon's dependence on spatial experience and imagination, and protects important anatomical structures during surgery. It is a significant clinical application value and potential.
引用
收藏
页数:8
相关论文
共 50 条
  • [1] Application of mixed reality technology in surgery
    Hu, Hongzhi
    Shao, Zengwu
    Ye, Lin
    Jin, Huan
    INTERNATIONAL JOURNAL OF CLINICAL AND EXPERIMENTAL MEDICINE, 2019, 12 (04): : 3107 - 3113
  • [2] Mixed Reality and Maxillofacial Surgery: An Interactive Twofold-Modality Application
    Agnese, Brunzini
    Andrea, Danieli
    Manila, Caragiuli
    Alida, Mazzoli
    Mario, Pagnoni
    Marco, Mandolini
    DESIGN TOOLS AND METHODS IN INDUSTRIAL ENGINEERING III, VOL 2, ADM 2023, 2024, : 504 - 511
  • [3] Development of virtual exhibition display system based on mixed reality technology
    1600, Journal of Chemical and Pharmaceutical Research (06):
  • [4] The application of virtual reality and augmented reality in Oral & Maxillofacial Surgery
    Ashraf Ayoub
    Yeshwanth Pulijala
    BMC Oral Health, 19
  • [5] The application of virtual reality and augmented reality in Oral & Maxillofacial Surgery
    Ayoub, Ashraf
    Pulijala, Yeshwanth
    BMC ORAL HEALTH, 2019, 19 (01)
  • [6] Design and Application of Culture Digital Display System Based on Virtual Reality Technology
    Zhang, Jialin
    2023 IEEE International Conference on Image Processing and Computer Applications, ICIPCA 2023, 2023, : 346 - 350
  • [7] Application of mixed reality bone registration and positioning technology in orthognathic surgery
    Huang, L.
    Liu, Y.
    Zhu, Z.
    Luo, E.
    INTERNATIONAL JOURNAL OF ORAL AND MAXILLOFACIAL SURGERY, 2025, 54 (04) : 346 - 351
  • [8] Mixed Reality based interaction system for digital heritage
    Bugalia, Nishant
    Kumar, Subodh
    Kalra, Prem
    Choudhary, Shantanu
    PROCEEDINGS VRCAI 2016: 15TH ACM SIGGRAPH CONFERENCE ON VIRTUAL-REALITY CONTINUUM AND ITS APPLICATIONS IN INDUSTRY, 2016, : 31 - 37
  • [9] Virtual Reality Technology and Its Application In Digital Campus System
    Liu De-feng
    Hao Ying
    Zhou Ke-qin
    2009 WRI WORLD CONGRESS ON SOFTWARE ENGINEERING, VOL 4, PROCEEDINGS, 2009, : 356 - 360
  • [10] Development of a Mixed Reality System Based on IoT and Augmented Reality
    Jenzeri, Dhia
    Chehri, Abdellah
    Jeon, Gwanggil
    2022 IEEE 96TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-FALL), 2022,