User Evaluation of a Shared Robot Control System Combining BCI and Eye Tracking in a Portable Augmented Reality User Interface

被引:1
作者
Dillen, Arnau [1 ,2 ,3 ]
Omidi, Mohsen [3 ,4 ]
Ghaffari, Fakhreddine [2 ]
Romain, Olivier [2 ]
Vanderborght, Bram [3 ,4 ]
Roelands, Bart [1 ,3 ]
Nowe, Ann [5 ]
De Pauw, Kevin [1 ,3 ]
机构
[1] Vrije Univ Brussel, Human Physiol & Sports Physiotherapy Res Grp, B-1050 Brussels, Belgium
[2] CY Cergy Paris Univ, Ecole Natl Super Elect & Ses Applicat ENSEA, Ctr Natl Rech Sci CNRS, Equipes Traitement Informat & Syst,UMR 8051, F-95000 Cergy, France
[3] Vrije Univ Brussel, Brussels Human Robot Res Ctr BruBot, B-1050 Brussels, Belgium
[4] IMEC, B-1050 Brussels, Belgium
[5] Vrije Univ Brussel, Artificial Intelligence Lab, B-1050 Brussels, Belgium
关键词
brain-computer interface; human-robot interaction; user evaluation; usability; assistive robotics; augmented reality; shared control; user experience; BRAIN-COMPUTER INTERFACE; USABILITY; DESIGN;
D O I
10.3390/s24165253
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
This study evaluates an innovative control approach to assistive robotics by integrating brain-computer interface (BCI) technology and eye tracking into a shared control system for a mobile augmented reality user interface. Aimed at enhancing the autonomy of individuals with physical disabilities, particularly those with impaired motor function due to conditions such as stroke, the system utilizes BCI to interpret user intentions from electroencephalography signals and eye tracking to identify the object of focus, thus refining control commands. This integration seeks to create a more intuitive and responsive assistive robot control strategy. The real-world usability was evaluated, demonstrating significant potential to improve autonomy for individuals with severe motor impairments. The control system was compared with an eye-tracking-based alternative to identify areas needing improvement. Although BCI achieved an acceptable success rate of 0.83 in the final phase, eye tracking was more effective with a perfect success rate and consistently lower completion times (p<0.001). The user experience responses favored eye tracking in 11 out of 26 questions, with no significant differences in the remaining questions, and subjective fatigue was higher with BCI use (p=0.04). While BCI performance lagged behind eye tracking, the user evaluation supports the validity of our control strategy, showing that it could be deployed in real-world conditions and suggesting a pathway for further advancements.
引用
收藏
页数:17
相关论文
共 78 条
  • [61] Autonomy in Physical Human-Robot Interaction: A Brief Survey
    Selvaggio, Mario
    Cognetti, Marco
    Nikolaidis, Stefanos
    Ivaldi, Serena
    Siciliano, Bruno
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) : 7989 - 7996
  • [62] Towards BCI-Based Interfaces for Augmented Reality: Feasibility, Design and Evaluation
    Si-Mohammed, Hakim
    Petit, Jimmy
    Jeunet, Camille
    Argelaguet, Ferran
    Spindler, Fabien
    Evain, Andeol
    Roussel, Nicolas
    Casiez, Gery
    Lecuyer, Anatole
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (03) : 1608 - 1621
  • [63] A Comprehensive Review on Critical Issues and Possible Solutions of Motor Imagery Based Electroencephalography Brain-Computer Interface
    Singh, Amardeep
    Hussain, Ali Abdul
    Lal, Sunil
    Guesgen, Hans W.
    [J]. SENSORS, 2021, 21 (06) : 1 - 35
  • [64] Comparing the effects of three cognitive tasks on indicators of mental fatigue
    Smith, Mitchell R.
    Chai, Rifai
    Nguyen, Hung T.
    Marcora, Samuele M.
    Coutts, Aaron J.
    [J]. JOURNAL OF PSYCHOLOGY, 2019, 153 (08) : 759 - 783
  • [65] Motor imagery and mental fatigue: inter-relationship and EEG based estimation
    Talukdar, Upasana
    Hazarika, Shyamanta M.
    Gan, John Q.
    [J]. JOURNAL OF COMPUTATIONAL NEUROSCIENCE, 2019, 46 (01) : 55 - 76
  • [66] Unity Technologies. Unity, 2024, Game Development Platform
  • [67] SciPy 1.0: fundamental algorithms for scientific computing in Python']Python
    Virtanen, Pauli
    Gommers, Ralf
    Oliphant, Travis E.
    Haberland, Matt
    Reddy, Tyler
    Cournapeau, David
    Burovski, Evgeni
    Peterson, Pearu
    Weckesser, Warren
    Bright, Jonathan
    van der Walt, Stefan J.
    Brett, Matthew
    Wilson, Joshua
    Millman, K. Jarrod
    Mayorov, Nikolay
    Nelson, Andrew R. J.
    Jones, Eric
    Kern, Robert
    Larson, Eric
    Carey, C. J.
    Polat, Ilhan
    Feng, Yu
    Moore, Eric W.
    VanderPlas, Jake
    Laxalde, Denis
    Perktold, Josef
    Cimrman, Robert
    Henriksen, Ian
    Quintero, E. A.
    Harris, Charles R.
    Archibald, Anne M.
    Ribeiro, Antonio H.
    Pedregosa, Fabian
    van Mulbregt, Paul
    [J]. NATURE METHODS, 2020, 17 (03) : 261 - 272
  • [68] Enhancing Motor-Imagery Brain-Computer Interface Training With Embodied Virtual Reality: A Pilot Study With Older Adults
    Vourvopoulos, Athanasios
    Blanco-Mora, Diego Andres
    Aldridge, Audrey
    Jorge, Carolina
    Figueiredo, Patricia
    Badia, Sergi Bermudez, I
    [J]. 2022 IEEE INTERNATIONAL CONFERENCE ON METROLOGY FOR EXTENDED REALITY, ARTIFICIAL INTELLIGENCE AND NEURAL ENGINEERING (METROXRAINE), 2022, : 157 - 162
  • [69] Burden of Stroke in Europe Thirty-Year Projections of Incidence, Prevalence, Deaths, and Disability-Adjusted Life Years
    Wafa, Hatem A.
    Wolfe, Charles D. A.
    Emmett, Eva
    Roth, Gregory A.
    Johnson, Catherine O.
    Wang, Yanzhong
    [J]. STROKE, 2020, 51 (08) : 2418 - 2427
  • [70] Wan ZT, 2021, NEUROCOMPUTING, V421, P1