Visuo-haptic augmented reality interaction algorithm based on Marker-SLAM

被引：0

作者：

Liu J. ^{[1
,2
]}

Xu C. ^{[1
,2
]}

Chen D. ^{[1
,2
]}

Qian C. ^{[1
]}

Shi H. ^{[1
,2
]}

机构：

[1] School of Automation, Nanjing University of Information Science & Technology, Nanjing

[2] Jiangsu Province Engineering Research Center of Intelligent Meteorological Exploration Robot (C-IMER), Nanjing University of Information Science & Technology, Nanjing

来源：

Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument | 2022年 / 43卷 / 08期

关键词：

Human-computer interaction; Marker-SLAM; Spatial transformation; Visuo-haptic augmented reality;

D O I：

10.19650/j.cnki.cjsi.J2209565

中图分类号：

学科分类号：

摘要：

The visuo-haptic augmented reality is a new technology that adds haptic perception to augmented reality, which helps to realize the integration of real scenes and virtual objects, as well as the synchronization of vision and touch. This article proposes a new visuo-haptic interaction algorithm based on the 3D Systems Touch haptic device. Firstly, an augmented reality environment built on the Marker-SLAM algorithm is adopted to obtain positions and poses of the camera in the map in real time. Secondly, to integrate haptic information into the augmented reality environment, a tracker-free stylus tip pose optimization algorithm is proposed. Finally, the 3D information of the measurement points in the haptic and world coordinate systems is collected respectively. The forward motion model of the haptic device is mapped into the augmented reality space by determining the rigid transformation between the two coordinate systems. The registration accuracy of the tracking registration methods proposed in this article is all above 90%. Different from the tracker-based method, the average error of the corrected position obtained by the pose optimization algorithm in this article is 2.3±0.2 mm. © 2022, Science Press. All right reserved.

引用

页码：26 / 38

页数：12

共 25 条

[1]

COSCO F, GARRE C, BRUNO F, Et al., Visuo-haptic mixed reality with unobstructed tool-hand integration, IEEE Transactions on Visualization and Computer Graphics, 19, 1, pp. 159-172, (2013)

[2]

ZHAO L, LIU Y, SONG W., Tactile perceptual thresholds of electrovibration in VR, IEEE Transactions on Visualization and Computer Graphics, 27, 5, pp. 2618-2626, (2021)

[3]

GROEN J, WERKHOVEN P J., Visuomotor adaptation to virtual hand position in interactive virtual environments, Presence, 7, 5, pp. 429-446, (1998)

[4]

MILANOVA M, ALDAEIF F., Markerless 3D virtual glasses try-on system, New Approaches for Multidimensional Signal Processing, pp. 99-111, (2021)

[5]

MCANALLY K, WALLIS G., Visual-haptic integration, action and embodiment in virtual reality, Psychological Research, (2021)

[6]

PROSKE U, CHEN B., Two senses of human limb position: Methods of measurement and roles in proprioception, Experimental Brain Research, 239, 11, pp. 3157-3174, (2021)

[7]

PREISSLER L, JOVANOVIC B, MUNZERT J, Et al., Effects of visual and visual-haptic perception of material rigidity on reaching and grasping in the course of development, Acta psychologica, 221, (2021)

[8]

SALVATO M, HERAVI N, OKAMURA A M, Et al., Predicting hand-object interaction for improved haptic feedback in mixed reality, IEEE Robotics and Automation Letters, 7, 2, pp. 3851-3857, (2022)

[9]

HAOMING L, WANTING H, ZHANPING F., Overview of the development of video see through technology in mixed reality technology and simulation application, IEEE 3rd International Conference on Civil Aviation Safety and Information Technology (ICCASIT), pp. 609-613, (2021)

[10]

LI J, ITO A, YAGUCHI H, Et al., Simultaneous kinematic calibration, localization, and mapping (SKCLAM) for industrial robot manipulators [J], Advanced Robotics, 33, 23, pp. 1225-1234, (2019)

← 1 2 3 →