SHARIDEAS: a smart collaborative assembly platform based on augmented reality supporting assembly intention recognition

被引:16
|
作者
Wang, Zhuo [1 ,2 ]
Wang, Yang [3 ]
Bai, Xiaoliang [1 ,2 ]
Huo, Xiangyu [4 ]
He, Weiping [1 ,2 ]
Feng, Shuo [1 ,2 ]
Zhang, Jie [1 ,2 ]
Zhang, Yueqing [1 ,2 ]
Zhou, Jinzhao [1 ,2 ]
机构
[1] Northwestern Polytech Univ, Cyber Phys Interact Lab, Sch Mechatron Engn, Xian 710072, Shaanxi, Peoples R China
[2] Cyber Real Innovat Ctr China, Nanjing 211200, Jiangsu, Peoples R China
[3] Xinxiang Aviat Ind Grp Co Ltd, Civil Aircraft Div, Xinxiang 453049, Henan, Peoples R China
[4] Zhengzhou Univ, Sch Mech & Power Engn, Zhengzhou 450052, Henan, Peoples R China
来源
INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY | 2021年 / 115卷 / 1-2期
关键词
Augmented reality; Intention recognition; Collaboration; Manual assembly;
D O I
10.1007/s00170-021-07142-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of augmented reality supporting manual assembly collaboration, it is particularly important to explore the transformation from traditional "human-machine" cooperation mode to smart "human-machine" cooperation mode. Early studies have shown that user cues (i.e., head, gesture, eye) and scene cues (i.e., objects, tools, space) are intuitive and highly expressive for traditional AR collaborative mode. However, how to integrate these cues into an assembly system, reasonably infer an operator's work intention, and then give an appropriate rendering scheme is one of the problems in collaborative assembly. This paper describes a AR collaborative assembly platform: SHARIDEAS. It uses a generalized grey correlation method to integrate user cues and scene cues. The results of data fusion can provide appropriate and intuitive assembly guidance for local workers. A formal user study is to explore the usability and feasibility of SHAREDEAS in a manual assembly task. The experimental data show that SHAREDEAS is more conducive than traditional one to improve the efficiency of human-machine cooperation. Finally, some conclusions of SHARIDEAS are given and the future research direction has prospected.
引用
收藏
页码:475 / 486
页数:12
相关论文
共 50 条
  • [21] Assembly Instruction With Augmented Reality On Android Application "Assembly With AR"
    Nugraha, Ismandra Eka
    Sen, Tjong Wan
    Wahyu, R. B.
    Sulistyo, Budi
    Rosalina
    PROCEEDINGS OF 2017 4TH INTERNATIONAL CONFERENCE ON NEW MEDIA STUDIES (CONMEDIA 2017), 2017, : 32 - 37
  • [22] Augmented reality smart glasses in industrial assembly: Current status and future challenges
    Danielsson, Oscar
    Holm, Magnus
    Syberfeldt, Anna
    JOURNAL OF INDUSTRIAL INFORMATION INTEGRATION, 2020, 20
  • [23] Projected augmented reality assembly assistance system supporting multi-modal interaction
    Jie Zhang
    Shuxia Wang
    Weiping He
    Jianghong Li
    Zhiwei Cao
    Bingzhao Wei
    The International Journal of Advanced Manufacturing Technology, 2022, 123 : 1353 - 1367
  • [24] Projected augmented reality assembly assistance system supporting multi-modal interaction
    Zhang, Jie
    Wang, Shuxia
    He, Weiping
    Li, Jianghong
    Cao, Zhiwei
    Wei, Bingzhao
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2022, 123 (3-4): : 1353 - 1367
  • [25] Augmented Reality Instruction for Object Assembly based on Markerless Tracking
    Wu, Li-Chen
    Lin, I-Chen
    Tsai, Ming-Han
    PROCEEDINGS I3D 2016: 20TH ACM SIGGRAPH SYMPOSIUM ON INTERACTIVE 3D GRAPHICS AND GAMES, 2016, : 95 - 102
  • [26] Assisted Human-Robot-Interaction for Industrial Assembly Application of Spatial Augmented Reality (SAR) for Collaborative Assembly Tasks
    Schmitt, Jan
    Hillenbrand, Andreas
    Kranz, Philipp
    Kaupp, Tobias
    HRI '21: COMPANION OF THE 2021 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, 2021, : 52 - 56
  • [27] Augmented Reality-Based Training of the PCB Assembly Process
    Hahn, Juergen
    Ludwig, Bernd
    Wolff, Christian
    PROCEEDINGS OF THE 14TH INTERNATIONAL CONFERENCE ON MOBILE AND UBIQUITOUS MULTIMEDIA (MUM 2015), 2015, : 395 - 399
  • [28] Augmented Reality Based Assembly Guidance for Spacecraft Conductive Network
    Chen, Huajun
    Sun, Gang
    Chen, Changyu
    Wan, Bile
    2018 4TH INTERNATIONAL CONFERENCE ON ENVIRONMENTAL SCIENCE AND MATERIAL APPLICATION, 2019, 252
  • [29] Demand Analysis for an Augmented Reality based Assembly Training.
    Werrlich, Stefan
    Nitsche, Kai
    Notni, Gunther
    10TH ACM INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS (PETRA 2017), 2017, : 416 - 422
  • [30] A Collaborative Augmented Reality Networked Platform for Edutainment
    Gu, Yuan Xun
    Li, Nai
    Chang, Leanne
    Duh, Henry Been-Lirn
    RECENT TRENDS OF MOBILE COLLABORATIVE AUGMENTED REALITY SYSTEMS, 2011, : 117 - 126