Shared Visualization and Collaborative Interaction Based on Multiple User Eye Tracking Data

被引：0
作者：
Cheng S.-W. [1 ]
Shen X.-Q. [1 ]
Sun L.-Y. [2 ]
Hu Y.-L. [1 ]
机构：
[1] School of Computer Science and Technology, Zhejiang University of Technology, Hangzhou
[2] State Key Laboratory of CAD & CG, Zhejiang University, Hangzhou
来源：
Ruan Jian Xue Bao/Journal of Software | 2019年 / 30卷 / 10期
基金：
中国国家自然科学基金;
关键词：
Computer supported cooperative work; Eye tracking; Human-computer interaction; Information visualization; Visual cognition;
D O I：
10.13328/j.cnki.jos.005784
中图分类号：
学科分类号：
摘要：
With the development of digital image processing technology and computer supported cooperative work, eye tracking has been applied in the process of multiuser collaborative interaction. However, existed eye tracking technique can only track single user's gaze, and the computing framework for multiple user's gaze data tracking is not mature; besides, the calibration process is much complex, and the eye tracking data recording, transition, and visualization mechanisms need to be further explored. Hence, this study proposed a new collaborative calibration method based on gradient optimization algorithms, so as to simplify the calibration process; and then in order to optimize the eye tracking data transition and management, the computing framework oriented to multiple user's eye tracking is proposed. Furthermore, to explore the influence of visual attention caused by visualization of eye tracking data sharing among multiple users, visualizations such as dots, clusters and trajectories are designed, and it is validated that the dots could improve the efficiency for collaborative visual search tasks. Finally, the code collaborative review systems are designed and built based on eye tracking, and this system could record, deliver, and visualize the eye tracking data in the forms of dots, code borders, code background, lines connected codes, among the code reviewing process. The user experiment result shows that, compared to the no eye tracking data sharing condition, sharing eye tracking data among multiple users can reduce the bug searching time with 20.1%, significantly improves the efficiency of collaborative work, and it validates the effectiveness of the proposed approach. © Copyright 2019, Institute of Software, the Chinese Academy of Sciences. All rights reserved.
引用
收藏
页码：3037 / 3053
页数：16
相关论文
共 33 条
[21]  
Cheng S.W., Sun Z.Q., Lu Y.H., An eye tracking approach to cross-device interaction, Journal of Computer-Aided Design & Computer Graphics, 28, 7, pp. 1094-1104, (2016)
[22]  
Shen X.Q., Research on collaborative eye tracking technique and interactive application, (2017)
[23]  
Zhang C., Chi J.N., Zhang Z.H., Et al., Gaze estimation in a gaze tracking system, Science China Information Sciences, 41, 5, pp. 580-591, (2011)
[24]  
Zhou X., Cai H., Li Y., Et al., Two-eye model-based gaze estimation from a Kinect sensor, Proc. of the 2017 IEEE Int'l Conf. on Robotics and Automation (ICRA), pp. 1646-1653, (2017)
[25]  
Su W., Boyd S., Candes E.J., A differential equation for modeling Nesterov's accelerated gradient method: Theory and insights, Advances in Neural Information Processing Systems, 3, 1, pp. 2510-2518, (2015)
[26]  
Cheng S.W., Sun Z.Q., An approach to eye tracking for mobile device based interaction, Journal of Computer-Aided Design & Computer Graphics, 26, 8, pp. 1354-1361, (2014)
[27]  
Wang L., Head-mounted gaze tracking system with head motion, (2014)
[28]  
Sellen A.J., Remote conversations: The effects of mediating talk with technology, Human Computer Interaction, 10, 4, pp. 401-444, (1995)
[29]  
Vertegaal R., The GAZE groupware system: Mediating joint attention in multiparty communication and collaboration, Proc. of the SIGCHI Conf. on Human Factors in Computing Systems, pp. 294-301, (1999)
[30]  
Gergle D., Kraut R.E., Fussell S.R., Language efficiency and visual technology: Minimizing collaborative effort with visual information, Journal of Language and Social Psychology, 23, 4, pp. 491-517, (2004)
1234