Off-Line Camera-Based Calibration for Optical See-Through Head-Mounted Displays

被引:14
作者
Cutolo, Fabrizio [1 ]
Fontana, Umberto [1 ]
Cattari, Nadia [2 ]
Ferrari, Vincenzo [1 ]
机构
[1] Univ Pisa, Informat Engn Dept, I-56126 Pisa, Italy
[2] Univ Pisa, EndoCAS Ctr, Dept Translat Res & New Technol Med & Surg, I-56126 Pisa, Italy
来源
APPLIED SCIENCES-BASEL | 2020年 / 10卷 / 01期
基金
欧盟地平线“2020”;
关键词
augmented reality; calibration; head mounted displays; optical see-through display; computer vision; SPATIAL CALIBRATION; AUGMENTED REALITY;
D O I
10.3390/app10010193
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Featured Application We here present a completely automated and fast method to calibrate optical see-through head-mounted displays based on the use of a calibrated camera replacing the user's eye. The method can work with any type of optical see-through display and it is easy to replicate in both laboratory environments and real-world settings. Abstract In recent years, the entry into the market of self contained optical see-through headsets with integrated multi-sensor capabilities has led the way to innovative and technology driven augmented reality applications and has encouraged the adoption of these devices also across highly challenging medical and industrial settings. Despite this, the display calibration process of consumer level systems is still sub-optimal, particularly for those applications that require high accuracy in the spatial alignment between computer generated elements and a real-world scene. State-of-the-art manual and automated calibration procedures designed to estimate all the projection parameters are too complex for real application cases outside laboratory environments. This paper describes an off-line fast calibration procedure that only requires a camera to observe a planar pattern displayed on the see-through display. The camera that replaces the user's eye must be placed within the eye-motion-box of the see-through display. The method exploits standard camera calibration and computer vision techniques to estimate the projection parameters of the display model for a generic position of the camera. At execution time, the projection parameters can then be refined through a planar homography that encapsulates the shift and scaling effect associated with the estimated relative translation from the old camera position to the current user's eye position. Compared to classical SPAAM techniques that still rely on the human element and to other camera based calibration procedures, the proposed technique is flexible and easy to replicate in both laboratory environments and real-world settings.
引用
收藏
页数:19
相关论文
共 36 条
[1]  
BAX MR, 2004, STANFORD ELECT E SPR, P9, DOI DOI 10.1109/ITSC.2003.1252685
[2]   Toed-in vs Parallel Displays in Video See-Through Head-Mounted Displays for Close-Up View [J].
Cattari, Nadia ;
Cutolo, Fabrizio ;
D'amato, Renzo ;
Fontana, Umberto ;
Ferrari, Vincenzo .
IEEE ACCESS, 2019, 7 :159698-159711
[3]   Recent Developments and Future Challenges in Medical Mixed Reality [J].
Chen, Long ;
Day, Thomas W. ;
Tang, Wen ;
John, Nigel W. .
PROCEEDINGS OF THE 2017 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR), 2017, :123-135
[4]  
Cutolo F, 2019, ANN BIOMED ENG, V47, P2151, DOI 10.1007/s10439-019-02299-w
[5]   Perspective Preserving Solution for Quasi-Orthoscopic Video See-Through HMDs [J].
Cutolo, Fabrizio ;
Fontana, Umberto ;
Ferrari, Vincenzo .
TECHNOLOGIES, 2018, 6 (01)
[6]   Hybrid Video/Optical See-Through HMD [J].
Cutolo, Fabrizio ;
Fontana, Umberto ;
Carbone, Marina ;
D'Amato, Renzo ;
Ferrari, Vincenzo .
ADJUNCT PROCEEDINGS OF THE 2017 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR-ADJUNCT), 2017, :52-57
[7]   Augmented reality visualization of deformable tubular structures for surgical simulation [J].
Ferrari, Vincenzo ;
Viglialoro, Rosanna Maria ;
Nicoli, Paola ;
Cutolo, Fabrizio ;
Condino, Sara ;
Carbone, Marina ;
Siesto, Mentore ;
Ferrari, Mauro .
INTERNATIONAL JOURNAL OF MEDICAL ROBOTICS AND COMPUTER ASSISTED SURGERY, 2016, 12 (02) :231-240
[8]   A fully automated calibration method for an optical see-through head-mounted operating microscope with variable zoom and focus [J].
Figl, M ;
Ede, C ;
Hummel, J ;
Wanschitz, F ;
Ewers, R ;
Bergmann, H ;
Birkfellner, W .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2005, 24 (11) :1492-1499
[9]   Closed - Loop Calibration for Optical See-Through Near Eye Display with Infinity Focus [J].
Fontana, Umberto ;
Cutolo, Fabrizio ;
Cattari, Nadia ;
Ferrari, Vincenzo .
ADJUNCT PROCEEDINGS OF THE 2018 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR), 2018, :51-56
[10]   Complete solution classification for the Perspective-Three-Point problem [J].
Gao, XS ;
Hou, XR ;
Tang, JL ;
Cheng, HF .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2003, 25 (08) :930-943