Automatic Recognition and Augmentation of Attended Objects in Real-time using Eye Tracking and a Head-mounted Display

被引：11

作者：

Barz, Michael ^{[1
]}

Kapp, Sebastian ^{[2
]}

Kuhn, Jochen ^{[2
]}

Sonntag, Daniel ^{[1
]}

机构：

[1] Oldenburg Univ, German Res Ctr Artificial Intelligence DFKI, Oldenburg, Germany

[2] Tech Univ Kaiserslautern, Kaiserslautern, Rlp, Germany

来源：

ACM SYMPOSIUM ON EYE TRACKING RESEARCH AND APPLICATIONS (ETRA 2021) | 2021年

关键词：

eye tracking; augmented reality; visual attention; cognition-aware computing; computer vision;

D O I：

10.1145/3450341.3458766

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Scanning and processing visual stimuli in a scene is essential for the human brain to make situation-aware decisions. Adding the ability to observe the scanning behavior and scene processing to intelligent mobile user interfaces can facilitate a new class of cognition-aware user interfaces. As a first step in this direction, we implement an augmented reality (AR) system that classifies objects at the user's point of regard, detects visual attention to them, and augments the real objects with virtual labels that stick to the objects in real-time. We use a head-mounted AR device (Microsoft HoloLens 2) with integrated eye tracking capabilities and a front-facing camera for implementing our prototype.

引用

页数：4

共 47 条

[41] A System for Mixed-Reality Holographic Overlays of Real-Time Rendered 3D-Reconstructed Imaging Using a Video Pass-through Head-Mounted Display-A Pathway to Future Navigation in Chest Wall Surgery
Arensmeyer, Jan
Bedetti, Benedetta
Schnorr, Philipp
Buermann, Jens
Zalepugas, Donatas
Schmidt, Joachim
Feodorovici, Philipp
JOURNAL OF CLINICAL MEDICINE, 2024, 13 (07)
[42] Real-time Monocular 6DoF Tracking of Textureless Objects using Photometrically-enhanced Edges
Valenca, Lucas
Silva, Luca
Chaves, Thiago
Gomes, Arlindo
Figueiredo, Lucas
Cossio, Lucio
Tandel, Sebastien
Lima, Joao Paulo
Simoes, Francisco
Teichrieb, Veronica
VISAPP: PROCEEDINGS OF THE 16TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS - VOL. 5: VISAPP, 2021, : 763 - 773
[43] Real-time Prediction of Students’ Math Difficulties using Raw Data from Eye Tracking and Neural Networks
Kennel K.
Ruzika S.
Proceedings of the ACM on Human-Computer Interaction, 2024, 8 (ETRA)
[44] Real-Time Recognition and Tracing of Moving Objects in Video Images using Background Subtraction, Kalman Filter and Particle Filter
Kwame, Adobah Benjamin
Liu, Guohai
Liu, Hui
Hussain, Fida
2019 25TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATION AND COMPUTING (ICAC), 2019, : 575 - 579
[45] Advancing Real-Time Remote Learning: A Novel Paradigm for Cognitive Enhancement Using EEG and Eye-Tracking Analytics
Jamil, Nuraini
Belkacem, Abdelkader Nasreddine
IEEE ACCESS, 2024, 12 : 93116 - 93132
[46] Real-Time Eye Tracking for Bare and Sunglasses-Wearing Faces for Augmented Reality 3D Head-Up Displays
Kang, Dongwoo
Ma, Lin
IEEE ACCESS, 2021, 9 : 125508 - 125522
[47] Automatic Real-Time Creation of Three-Dimensional (3D) Representations of Objects, Buildings, or Scenarios Using Drones and Artificial Intelligence Techniques
Blasco, Jorge Cujo
Rosende, Sergio Bemposta
Sanchez-Soriano, Javier
DRONES, 2023, 7 (08)

← 1 2 3 4 5 →