Automatic Recognition and Augmentation of Attended Objects in Real-time using Eye Tracking and a Head-mounted Display

被引：11

作者：

Barz, Michael ^{[1
]}

Kapp, Sebastian ^{[2
]}

Kuhn, Jochen ^{[2
]}

Sonntag, Daniel ^{[1
]}

机构：

[1] Oldenburg Univ, German Res Ctr Artificial Intelligence DFKI, Oldenburg, Germany

[2] Tech Univ Kaiserslautern, Kaiserslautern, Rlp, Germany

来源：

ACM SYMPOSIUM ON EYE TRACKING RESEARCH AND APPLICATIONS (ETRA 2021) | 2021年

关键词：

eye tracking; augmented reality; visual attention; cognition-aware computing; computer vision;

D O I：

10.1145/3450341.3458766

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Scanning and processing visual stimuli in a scene is essential for the human brain to make situation-aware decisions. Adding the ability to observe the scanning behavior and scene processing to intelligent mobile user interfaces can facilitate a new class of cognition-aware user interfaces. As a first step in this direction, we implement an augmented reality (AR) system that classifies objects at the user's point of regard, detects visual attention to them, and augments the real objects with virtual labels that stick to the objects in real-time. We use a head-mounted AR device (Microsoft HoloLens 2) with integrated eye tracking capabilities and a front-facing camera for implementing our prototype.

引用

页数：4

共 47 条

[1] Real-time Gaze Tracking with Head-eye Coordination for Head-mounted Displays
Chen, Lingling
Li, Yingxi
Bai, Xiaowei
Wang, Xiaodong
Hu, Yongqiang
Song, Mingwu
Xie, Liang
Yan, Ye
Yin, Erwei
2022 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR 2022), 2022, : 82 - 91
[2] EyeRecToo: Open-source Software for Real-time Pervasive Head-mounted Eye Tracking
Santini, Thiago
Fuhl, Wolfgang
Geisler, David
Kasneci, Enkelejda
PROCEEDINGS OF THE 12TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISIGRAPP 2017), VOL 6, 2017, : 96 - 101
[3] Individualized foveated rendering with eye-tracking head-mounted display
Kim, Jihwan
Kim, Jejoong
Jung, Myeongul
Kwon, Taesoo
Kim, Kwanguk Kenny
VIRTUAL REALITY, 2024, 28 (01)
[4] Individualized foveated rendering with eye-tracking head-mounted display
Jihwan Kim
Jejoong Kim
Myeongul Jung
Taesoo Kwon
Kwanguk Kenny Kim
Virtual Reality, 2024, 28
[5] Concept for Using Eye Tracking in a Head-Mounted Display to Adapt Rendering to the User's Current Visual Field
Pohl, Daniel
Zhang, Xucong
Bulling, Andreas
Grau, Oliver
22ND ACM CONFERENCE ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY (VRST 2016), 2016, : 323 - 324
[6] An Extended Method for Saccadic Eye Movement Measurements Using a Head-Mounted Display
Lee, Youngkeun
Kumar, Yadav Sunil
Lee, Daehyeon
Kim, Jihee
Kim, Junggwon
Yoo, Jisang
Kwon, Soonchul
HEALTHCARE, 2020, 8 (02)
[7] Get a Grip: Slippage-Robust and Glint-Free Gaze Estimation for Real-Time Pervasive Head-Mounted Eye Tracking
Santini, Thiago
Niehorster, Diederick C.
Kasneci, Enkelejda
ETRA 2019: 2019 ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS, 2019,
[8] Real-Time Tracking of Visually Attended Objects in Interactive Virtual Environments
Lee, Sungkil
Kim, Gerard Jounghyun
Choi, Seungmoon
VRST 2007: ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY, PROCEEDINGS, 2007, : 29 - 38
[9] Augmented Reality for Presenting Real-Time Data During Students' Laboratory Work: Comparing a Head-Mounted Display With a Separate Display
Thees, Michael
Altmeyer, Kristin
Kapp, Sebastian
Rexigel, Eva
Beil, Fabian
Klein, Pascal
Malone, Sarah
Bruenken, Roland
Kuhn, Jochen
FRONTIERS IN PSYCHOLOGY, 2022, 13
[10] Real-Time Onboard Object Detection for Augmented Reality: Enhancing Head-Mounted Display with YOLOv8
Lysakowski, Mikolaj
Zywanowski, Kamil
Banaszczyk, Adam
Nowicki, Michal R.
Skrzypczynski, Piotr
Tadeja, Slawomir K.
2023 IEEE INTERNATIONAL CONFERENCE ON EDGE COMPUTING AND COMMUNICATIONS, EDGE, 2023, : 364 - 371

← 1 2 3 4 5 →