High-speed active vision pose perception and tracking method based on Pan-Tilt mirrors for 6-DOF dynamic projection mapping

被引：0

作者：

Huang, Shuangjiang ^{[1
]}

Song, Fengnian ^{[1
]}

Wang, Lihui ^{[2
,3
]}

Huang, Yutao ^{[4
]}

He, Yuan ^{[5
]}

Bai, Shi ^{[1
]}

Chen, Tao ^{[2
]}

Ishikawa, Masatoshi ^{[6
]}

机构：

[1] Shenyang Univ Technol, Sch Informat Sci & Engn, Shenyang 110870, Peoples R China

[2] Soochow Univ, Sch Future Sci & Engn, Suzhou 215222, Peoples R China

[3] Guangdong Acad Sci, Inst Semicond, Guangzhou 510650, Peoples R China

[4] Wuyi Univ, Coll Text Sci & Engn, Jiangmen 529020, Peoples R China

[5] Keio Univ, Grad Sch Sci & Technol, Tokyo 1088345, Japan

[6] Tokyo Univ Sci, Tokyo 1138601, Japan

来源：

OPTICS AND LASERS IN ENGINEERING | 2025年 / 188卷

关键词：

6-DOF dynamic projection mapping; High-speed vision tracking; Real-time non-contact perception; Active vision system; CAMERA; IMAGE;

D O I：

10.1016/j.optlaseng.2025.108888

中图分类号：

O43 [光学];

学科分类号：

070207 ; 0803 ;

摘要：

Active vision tracking projection mapping technology holds promise for augmented reality, autonomous driving, and robot navigation. However, it performs suboptimally with high-speed, randomly moving targets due to the difficulty in synchronizing accurate pose perception and high-dynamic vision tracking across a large field of view. Therefore, we proposed a high-speed active vision pose perception and tracking method for 6 degree-of-freedom (DOF) dynamic projection mapping. We designed a tracking method for an optical active vision system based on a Pan-Tilt mirror, which blends a pupil drift optical module field of view enhancement module and a Pan-Tilt optical axis control design, to achieve feedback control tracking of high-speed moving targets. The experimental results show that the tracking errors in the x and y directions are less than 25 pixels, and the maximum response time of the system is less than 5 ms. The projection position error is not more than 61.9 mm, and the rotation error is less than 4 degrees. This method effectively achieves 6-DOF dynamic projection of high-speed moving targets, exhibiting enhanced accuracy and responsiveness in dynamic scenarios.

引用

页数：13

共 44 条

[1] Chang C., Bang K., Wetzstein G., Lee B., Gao L., Toward the next-generation vr/ar optics: a review of holographic near-eye displays from a human-centric perspective, Optica, 7, pp. 1563-1578, (2020)
[2] Arena F., Collotta M., Pau G., Termine F., An overview of augmented reality, Computers, 11, (2022)
[3] Kim H.G., Lim H.-T., Ro Y.M., Deep virtual reality image quality assessment with human perception guider for omnidirectional image, IEEE Trans Circuits Syst Video Technol, 30, pp. 917-928, (2020)
[4] Ibrahim M.T., Gopi M., Majumder A., Self-calibrating dynamic projection mapping system for dynamic, deformable surfaces with jitter correction and occlusion handling, 2023 IEEE international symposium on mixed and augmented reality (ISMAR), pp. 293-302, (2023)
[5] Zhang H., Head-mounted display-based intuitive virtual reality training system for the mining industry, Int J Min Sci Technol, 27, pp. 717-722, (2017)
[6] Yasui M., Iwataki R., Ishikawa M., Watanabe Y., Projection mapping with a brightly lit surrounding using a mixed light field approach, IEEE Trans Vis Comput Graph, 30, pp. 2217-2227, (2024)
[7] Peng H.-L., Watanabe Y., High-speed human arm projection mapping with skin deformation, SIGGRAPH Asia 2020 emerging technologies, SA '20, pp. 1-2, (2020)
[8] Drummond T., Cipolla R., Real-time visual tracking of complex structures, IEEE Trans Pattern Anal Mach Intell, 24, pp. 932-946, (2002)
[9] Miyashita L., Watanabe Y., Ishikawa M., Midas projection: markerless and modelless dynamic projection mapping for material representation, ACM Trans Graph, 37, pp. 1-12, (2018)
[10] Mikawa Y., Sueishi T., Watanabe Y., Ishikawa M., Variolight: hybrid dynamic projection mapping using high-speed projector and optical axis controller, SIGGRAPH Asia 2018 emerging technologies, pp. 1-2, (2018)

← 1 2 3 4 5 →