Fast Calibration with OTS for AR-based Surgical Navigation

被引：1

作者：

Cai, Hualin ^{[1
]}

Ding, Rui ^{[2
]}

Huang, Weizhuo ^{[1
]}

Zhan, Yinwei ^{[1
]}

Yang, Rongqian ^{[3
]}

机构：

[1] Guangdong Univ Technol, Sch Comp Sci & Technol, Guangzhou, Peoples R China

[2] South China Univ Technol, Sch Mat Sci & Engn, Guangzhou, Peoples R China

[3] South China Univ Technol, Sch Elect & Informat Engn, Guangzhou, Peoples R China

来源：

2021 27TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE (M2VIP) | 2021年

关键词：

Augmented reality; Surgical navigation; Calibration; Hololens;

D O I：

10.1109/M2VIP49856.2021.9665005

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

With the augmented reality (AR) surgical navigation system, surgeons can more intuitively see the lesions during surgery. In this respect, calibration is an essential step in optical visual system for AR. While there have been various calibration methods to register virtual holographical space and surgical space, the operation is considerably complex and time-consuming for users unfamiliar with these operations. For this, we adopt HoloLens 2 as the AR display and propose a calibration method between an optical tracking system (OTS) and the HoloLens. With this method, the transformation matrix between the calibratiion tool and the camera on HoloLens can be fixed and thus users can quickly complete the calibration task. An AR-based surgical navigation system is further developed. Experiments show that in the circumstances of a relatively satisfying average error of 7.212 +/- 1.098 mm, users can finish the process of calibration within 15s.

引用

页数：6

共 17 条

[1] Recent advances in augmented reality [J].

Azuma, R ;

Baillot, Y ;

Behringer, R ;

Feiner, S ;

Julier, S ;

MacIntyre, B .

IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2001, 21 (06) :34-47

[2] Recent Developments and Future Challenges in Medical Mixed Reality [J].

Chen, Long ;

Day, Thomas W. ;

Tang, Wen ;

John, Nigel W. .

PROCEEDINGS OF THE 2017 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR), 2017, :123-135

[3] Singular Value Decomposition and its Applications in Image Processing [J].

Chen, Zihan .

ICOMS 2018: 2018 INTERNATIONAL CONFERENCE ON MATHEMATICS AND STATISTICS, 2018, :16-22

[4] Automatic 3D Registration of CT-MR Head and Neck Images With Surface Matching [J].

Chu, Qin ;

Zhan, Yinwei ;

Guo, Fanqing ;

Song, Mengchun ;

Yang, Rongqian .

IEEE ACCESS, 2019, 7 :78274-78280

[5] Perceptual Limits of Optical See-Through Visors for Augmented Reality Guidance of Manual Tasks [J].

Condino, Sara ;

Carbone, Marina ;

Piazza, Roberta ;

Ferrari, Mauro ;

Ferrari, Vincenzo .

IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2020, 67 (02) :411-419

[6] An Online Calibration Method for Microsoft HoloLens [J].

Guo, Na ;

Wang, Tianmiao ;

Yang, Biao ;

Hu, Lei ;

Liu, Hongsheng ;

Wang, Yuhan .

IEEE ACCESS, 2019, 7 :101795-101803

[7] A Hybrid Model for Liver Shape Segmentation with Customized Fast Marching and Improved GMM-EM [J].

Huang, Weizhuo ;

Zhan, Yinwei ;

Yang, Rongqian .

IMAGE AND GRAPHICS, ICIG 2019, PT II, 2019, 11902 :495-508

[8] Pedicle screw navigation using surface digitization on the Microsoft HoloLens [J].

Liebmann, Florentin ;

Roner, Simon ;

von Atzigen, Marco ;

Scaramuzza, Davide ;

Sutter, Reto ;

Snedeker, Jess ;

Farshad, Mazda ;

Furnstahl, Philipp .

INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2019, 14 (07) :1157-1165

[9] Robust Stereo-Match Algorithm for Infrared Markers in Image-Guided Optical Tracking System [J].

Lin, Qinyong ;

Yang, Rongqian ;

Zhang, Zhesi ;

Cai, Ken ;

Wang, Zhigang ;

Huang, Meiping ;

Huang, Jinhua ;

Zhan, Yinwei ;

Zhuang, Jian .

IEEE ACCESS, 2018, 6 :52421-52433

[10]

McInerney J, 2000, MT SINAI J MED, V67, P300

← 1 2 →