A novel adaptive visualization method based on user intention in AR manual assembly

被引:4
作者
Yan, Yuxiang [1 ]
Bai, Xiaoliang [1 ]
He, Weiping [1 ]
Wang, Shuxia [1 ]
Zhang, Xiangyu [1 ]
Wang, Peng [2 ]
Liu, Liwei [1 ]
Yu, Qing [1 ]
机构
[1] Northwestern Polytech Univ, Cyber Phys Interact Lab, Xian 710072, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Sch Adv Mfg Engn, Chongqing 400065, Peoples R China
关键词
User intention; Eye gaze; Spatial location; Adaptive; Visualization; Augmented reality; AUGMENTED REALITY AR; DESIGN;
D O I
10.1007/s00170-023-12557-w
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
AR assembly instruction is a method that helps users with manual assembly by overlaying virtual information on the real environment. However, users have to manually change the information display form, which fails to adapt to their varying information needs in different stages of the assembly task. This study proposes a user-centered adaptive visualization method for AR manual assembly that can provide the necessary information according to the user's intention in the assembly process. This paper develops a system (UIAVS) through an information hierarchy mechanism and a user intention recognition method based on the user's eye gaze, the spatial location, and current assembly task, which can adaptively adjust the visibility of information, how much information is displayed, and the change of visualization form. UIAVS was tested for the first time in a small engine assembly task. Twenty-four participants were randomly assigned to different task familiarity (novice and expert) and different information visualization response methods for assembly task experiments. The results show that UIAVS has better task performance and cognitive performance as well as user experience than traditional AR assembly instruction method, especially for experts. The research results have certain guiding significance for the design of AR assembly instructions, which extends the application of AR technology in practical complex assembly tasks.
引用
收藏
页码:4705 / 4730
页数:26
相关论文
共 65 条
[11]   Augmented reality-based guidance in product assembly and maintenance/repair perspective: A state of the art review on challenges and opportunities [J].
Eswaran, M. ;
Gulivindala, Anil Kumar ;
Inkulu, Anil Kumar ;
Bahubalendruni, M. V. A. Raju .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 213
[12]  
Feiner S., 1993, Sixth Annual Symposium on User Interface Software and Technology. Proceedings of the ACM Symposium on User Interface Software and Technology, P145, DOI 10.1145/168642.168657
[13]   KNOWLEDGE-BASED AUGMENTED REALITY [J].
FEINER, S ;
MACINTYRE, B ;
SELIGMANN, D .
COMMUNICATIONS OF THE ACM, 1993, 36 (07) :53-62
[14]   Eye-tracking for human-centered mixed reality: promises and challenges [J].
Gardony, Aaron L. ;
Lindeman, Robert W. ;
Brunye, Tad T. .
OPTICAL ARCHITECTURES FOR DISPLAYS AND SENSING IN AUGMENTED, VIRTUAL, AND MIXED REALITY (AR, VR, MR), VOL. 11310, 2020, 11310
[15]   A systematic design method of adaptive augmented reality work instruction for complex industrial operations [J].
Geng, Junhao ;
Song, Xinyu ;
Pan, Yuntao ;
Tang, Jianjun ;
Liu, Yu ;
Zhao, Dongping ;
Ma, Yongsheng .
COMPUTERS IN INDUSTRY, 2020, 119
[16]  
Ghouaiel N., 2014, P 2014 VIRT REAL INT, P1, DOI DOI 10.1145/2617841.2620695
[17]   Model-Based Definition and Enterprise: State-of-the-art and future trends [J].
Goher, Kamran ;
Shehab, Essam ;
Al-Ashaab, Ahmed .
PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART B-JOURNAL OF ENGINEERING MANUFACTURE, 2021, 235 (14) :2288-2299
[18]  
HART S G, 1988, P139
[19]   Developing a UX KPI based on the user experience questionnaire [J].
Hinderks, Andreas ;
Schrepp, Martin ;
Dominguez Mayo, Francisco Jose ;
Jose Escalona, Maria ;
Thomaschewski, Joerg .
COMPUTER STANDARDS & INTERFACES, 2019, 65 :38-44
[20]   Estimating Visibility of Annotations for View Management in Spatial Augmented Reality Based on Machine-Learning Techniques [J].
Ichihashi, Keita ;
Fujinami, Kaori .
SENSORS, 2019, 19 (04)