An accurate 3D augmented reality navigation system with enhanced autostereoscopic display for oral and maxillofacial surgery

被引:5
|
作者
Han, Boxuan [1 ]
Li, Ruiyang [1 ]
Huang, Tianqi [1 ]
Ma, Longfei [1 ]
Liang, Hanying [1 ]
Zhang, Xinran [1 ]
Liao, Hongen [1 ]
机构
[1] Tsinghua Univ, Dept Biomed Engn, Sch Med, Beijing 100084, Peoples R China
来源
INTERNATIONAL JOURNAL OF MEDICAL ROBOTICS AND COMPUTER ASSISTED SURGERY | 2022年 / 18卷 / 04期
基金
中国国家自然科学基金;
关键词
augmented reality; autostereoscopic display; eye tracking; optical see-through; surgical navigation; SURGICAL NAVIGATION; IMAGE OVERLAY;
D O I
10.1002/rcs.2404
中图分类号
R61 [外科手术学];
学科分类号
摘要
Background Oral and maxillofacial surgery demands high precision navigation to achieve optimal surgical outcomes. Augmented reality (AR) has been a promising solution for intuitive and accurate guidance, whereas existing systems have room for improvement. Methods We propose a high quality and accurate in situ AR navigation system. Enhanced image quality is achieved by deploying eye tracking in lenticular-based autostereoscopic display. Viewpoint tracking and optical tracking are integrated to assure accurate in situ images. Results The proposed system can provide in situ AR images in real-time, with a viewing angle of 59.5 degrees x 49.1 degrees, 3D image resolution of 0.35 x 0.21 mm, and image accuracy of 0.99 +/- 0.70 mm. A maxillary drilling experiment obtains average position error of 1.12 +/- 0.30 mm and localization time of 8.7 +/- 3.9 s, significantly better than conventional 2D navigation system. Conclusions The proposed system can display high-quality AR images and therefore reduce positioning error and operating time.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Autostereoscopic 3D Augmented Reality Navigation for Laparoscopic Surgery: A Preliminary Assessment
    Zhang, Xiaohui
    Otoo, Elsa-Marie
    Fan, Yubo
    Tao, Chunjing
    Wang, Tianmiao
    Rhode, Kawal
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2023, 70 (04) : 1413 - 1421
  • [2] Augmented reality autostereoscopic 3D display based on sparse reflection array
    Ma, Xiao-Li
    Yuan, Rong-Ying
    Zhang, Lin-Bo
    He, Min-Yang
    Zhang, Han-Le
    Xing, Yan
    Wang, Qiong-Hua
    OPTICS COMMUNICATIONS, 2022, 510
  • [3] Accurate Stereo View Synthesis for an Autostereoscopic 3D Display
    Rhee, Seon-Min
    Choi, Jongmoo
    Choi, Soo-Mi
    2010 DIGEST OF TECHNICAL PAPERS INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS ICCE, 2010,
  • [4] Augmented Reality System for Oral Surgery Using 3D Auto Stereoscopic Visualization
    Huy Hoang Tran
    Suenaga, Hideyuki
    Kuwana, Kenta
    Masamune, Ken
    Dohi, Takeyoshi
    Nakajima, Susumu
    Liao, Hongen
    MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, MICCAI 2011, PT I, 2011, 6891 : 81 - +
  • [5] Transparent 3D display for augmented reality
    Lee, Byoungho
    Hong, Jisoo
    HOLOGRAPHY, DIFFRACTIVE OPTICS, AND APPLICATIONS V, 2012, 8556
  • [6] A proof-of-concept augmented reality system in oral and maxillofacial surgery
    Dang, Nathalie Pham
    Chandelon, Kilian
    Barthemy, Isabelle
    Devoize, Laurent
    Bartoli, Adrien
    JOURNAL OF STOMATOLOGY ORAL AND MAXILLOFACIAL SURGERY, 2021, 122 (04) : 338 - 342
  • [7] Autostereoscopic 3D Display System for 3D Medical Images
    Kang, Dongwoo
    Choi, Jin-Ho
    Hwang, Hyoseok
    APPLIED SCIENCES-BASEL, 2022, 12 (09):
  • [8] The application of virtual reality and augmented reality in Oral & Maxillofacial Surgery
    Ashraf Ayoub
    Yeshwanth Pulijala
    BMC Oral Health, 19
  • [9] The application of virtual reality and augmented reality in Oral & Maxillofacial Surgery
    Ayoub, Ashraf
    Pulijala, Yeshwanth
    BMC ORAL HEALTH, 2019, 19 (01)
  • [10] 3D Quantitative Evaluation System for Autostereoscopic Display
    Fan, Zhencheng
    Zhang, Sen
    Weng, Yitong
    Chen, Guowen
    Liao, Hongen
    JOURNAL OF DISPLAY TECHNOLOGY, 2016, 12 (10): : 1185 - 1196