Multi-User Surgical Navigation Platform Based on Mixed Reality

被引：0
|
作者：
Chiou, Shin-Yan [1 ,2 ,3 ]
Liu, Tao-Ming [4 ]
Liu, Hao-Li [4 ,5 ]
机构：
[1] Chang Gung Univ, Coll Engn, Dept Elect Engn, Taoyuan 33302, Taiwan
[2] Keelung Chang Gung Mem Hosp, Dept Neurosurg, Keelung 20401, Taiwan
[3] Dept Tradit Chinese Med, Div Acupuncture & Moxibust, Linkou Chang Gung Mem, Taoyuan 33302, Taiwan
[4] Natl Taiwan Univ, Dept Elect Engn, Taipei 106319, Taiwan
[5] Natl Taiwan Univ, Grad Inst Biomed Elect & Bioinformat, Taipei 10617, Taiwan
来源：
IEEE ACCESS | 2024年 / 12卷
关键词：
Surgery; Navigation; Three-dimensional displays; Real-time systems; Mixed reality; Ultrasonic imaging; Collaboration; Accuracy; Optical imaging; Visualization; Mixed reality navigation; surgical guidance system; 3D ultrasound visualization; multi-user collaboration; HoloLens; 2; AUGMENTED REALITY; SURGERY;
D O I：
10.1109/ACCESS.2024.3486151
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Extended Reality (XR) technology enables visualization of patient data during surgery, with Augmented Reality (AR) systems offering 2D or 3D navigation. However, current systems face limitations such as lack of depth in 2D navigation, restricted single-user functionality in 3D navigation, and limited interoperability between tracking markers and navigation platforms. Additionally, users cannot interact with virtual objects, reducing operational efficiency and intuitiveness. This study addresses these issues by proposing a multi-user Mixed Reality (MR) guidance platform that provides interactive, real-time feedback and enhances collaboration. The platform maps 3D medical models onto real-world objects using 2D marker calibration, supporting focused ultrasound for transcranial brain therapy. Integration with BrainLab and HoloLens 2 achieved a single-user positioning accuracy of 0.576 +/- 0.294mm, with multi-user alignment errors averaging 2.718 +/- 1.335mm. The system maintained a frame rate of 50-60 FPS, demonstrating robust performance and precision.
引用
收藏
页码：162522 / 162535
页数：14
相关论文
共 50 条
  • [41] A multi-user virtual reality experience for space missions
    Del Mastro, A.
    Monaco, F.
    Benyoucef, Y.
    JOURNAL OF SPACE SAFETY ENGINEERING, 2021, 8 (02): : 134 - 137
  • [42] Mixed reality based teleoperation and visualization of surgical robotics
    Ai, Letian
    Kazanzides, Peter
    Azimi, Ehsan
    HEALTHCARE TECHNOLOGY LETTERS, 2024, 11 (2-3) : 179 - 188
  • [43] Conveying Perspective in Multi-User Virtual Reality Collaborations
    Freiwald, Jann Philipp
    Diedrichsen, Lennart
    Baur, Alexander
    Manka, Oliver
    Jorshery, Pedram Berendjy
    Steinicke, Frank
    MUC 2020: PROCEEDINGS OF MENSCH UND COMPUTER 2020, 2020, : 137 - 144
  • [44] SEAR: Scaling Experiences in Multi-user Augmented Reality
    Zhang, Wenxiao
    Han, Bo
    Hui, Pan
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (05) : 1982 - 1992
  • [45] Mixed reality for visualization of orthopedic surgical anatomy
    Chytas, Dimitrios
    Nikolaou, Vasileios S.
    WORLD JOURNAL OF ORTHOPEDICS, 2021, 12 (10): : 727 - 731
  • [46] Mixed Reality in Modern Surgical and Interventional Practice: Narrative Review of the Literature
    Vervoorn, Mats T.
    Wulfse, Maaike
    Van Doormaal, Tristan P. C.
    Ruurda, Jelle P.
    Van der Kaaij, Niels P.
    De Heer, Linda M.
    JMIR SERIOUS GAMES, 2023, 11
  • [47] Toward Supporting Maxillo-Facial Surgical Guides Positioning with Mixed Reality-A Preliminary Study
    Piramide, Chiara
    Ulrich, Luca
    Piazzolla, Pietro
    Vezzetti, Enrico
    APPLIED SCIENCES-BASEL, 2022, 12 (16):
  • [48] Toward 6G-Based Metaverse: Supporting Highly-Dynamic Deterministic Multi-User Extended Reality Services
    Yu, Hao
    Shokrnezhad, Masoud
    Taleb, Tarik
    Li, Richard
    Song, JaeSeung
    IEEE NETWORK, 2023, 37 (04): : 30 - 38
  • [49] Hybrid Augmented Reality for Participatory Learning: The Hidden Efficacy of Multi-User Game-Based Simulation
    Oh, Seungjae
    So, Hyo-Jeong
    Gaydos, Matthew
    IEEE TRANSACTIONS ON LEARNING TECHNOLOGIES, 2018, 11 (01): : 115 - 127
  • [50] Development of a surgical navigation system for corrective osteotomy based on augmented reality
    Bong, Jae Hwan
    Kim, Hyungmin
    Park, Shinsuk
    INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING, 2017, 18 (07) : 1057 - 1062
12345