Exploring Design Opportunities for Intelligent Worker Assistance: A New Approach Using Projetion-Based AR and a Novel Hand-Tracking Algorithm

被引:23
作者
Buettner, Sebastian [1 ]
Sand, Oliver [1 ]
Roecker, Carsten [1 ]
机构
[1] Ostwestfalen Lippe Univ Appl Sci, Lemgo, Germany
来源
AMBIENT INTELLIGENCE (AMI 2017) | 2017年 / 10217卷
关键词
Augmented reality; Mobile projection; Hand tracking; Manufacturing; Industry; 4.0; SYSTEMS;
D O I
10.1007/978-3-319-56997-0_3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents a prototype of an intelligent assistive system for workers in stationary manual assembly using projection-based augmented reality (AR) and intelligent hand tracking. By using depth cameras, the system can track the hands of the user and makes the user aware of wrong picking actions or errors in the assembly process. The system automatically adapts the digital projection-based overlay according to the current work situation. The main research contribution of our work is the presentation of a novel hand-tracking algorithm. In addition, we present the results of an user study of the system that shows the challenges and opportunities of our system and the hand-tracking algorithm in particular. We assume that our results will inform the future design of assistive systems in manual assembly.
引用
收藏
页码:33 / 45
页数:13
相关论文
共 18 条
[1]  
[Anonymous], 2015, P 8 ACM INT C PERVAS
[2]  
[Anonymous], 2015, P 17 INT C HUM COMP, DOI DOI 10.1145/2786567.2794342
[3]  
[Anonymous], 2008, 1 INT COTESYS WORKSH
[4]  
Billinghurst M., 2008, P 7 INT C MOBILE UBI, P84, DOI DOI 10.1145/1543137.1543153
[5]  
Buttner S., 2016, P 9 ACM INT C PERVAS, V8
[6]   A survey of glove-based systems and their applications [J].
Dipietro, Laura ;
Sabatini, Angelo M. ;
Dario, Paolo .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2008, 38 (04) :461-482
[7]   Using In-Situ Projection to Support Cognitively Impaired Workers at the Workplace [J].
Funk, Markus ;
Mayer, Sven ;
Schmidt, Albrecht .
ASSETS'15: PROCEEDINGS OF THE 17TH INTERNATIONAL ACM SIGACCESS CONFERENCE ON COMPUTERS & ACCESSIBILITY, 2015, :185-192
[8]  
Guo Anhong., 2014, P 2014 ACM INT S WEA, P71, DOI DOI 10.1145/2634317.2634321
[9]  
HART S G, 1988, P139
[10]  
Kirch Martin, 2014, Smart SysTech 2014. European Conference on Smart Objects, Systems and Technologies, P1