Control of Electric Wheelchair by Brain-Computer Interface Using Mixed Reality and Virtual Sound Source

被引:1
作者
Mori, Fumina [1 ]
Sugino, Masato [1 ]
Huang, Yunshan [1 ]
Kotani, Kiyoshi [2 ]
Jimbo, Yasuhiko [1 ]
机构
[1] Univ Tokyo, Grad Sch Engn, Hongo 7-3-1, Bunkyo, Tokyo 1138656, Japan
[2] Univ Tokyo, Grad Sch Frontier Sci, 5-1-5 Kashiwanoha, Kashiwa, Chiba 2778563, Japan
关键词
electroencephalography; brain-computer interface; mixed reality; audiovisual stimuli; virtual sound source; wheelchair; BCI;
D O I
10.1002/tee.24050
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A brain-computer interface for operating an electric wheelchair (wheelchair BCI) has been studied to support independent living for physically disabled patients. The current wheelchair BCI systems are facing the problem that the wheelchair cannot be moved or rotated to an arbitrary place or direction in a single measurement. To solve this problem, we developed a BCI that uses audiovisual stimuli based on mixed-reality (MR) and virtual sound sources. During the online analysis, six out of seven participants were able to move or rotate the wheelchair to the target location or direction at a rate higher than the chance level. Thus, our results indicate that audiovisual stimulation with MR and virtual sound sources may be useful for intuitive wheelchair operation. (c) 2024 Institute of Electrical Engineer of Japan and Wiley Periodicals LLC.
引用
收藏
页码:1014 / 1025
页数:12
相关论文
共 22 条
[1]   Exploring Combinations of Auditory and Visual Stimuli for Gaze-Independent Brain-Computer Interfaces [J].
An, Xingwei ;
Hoehne, Johannes ;
Ming, Dong ;
Blankertz, Benjamin .
PLOS ONE, 2014, 9 (10)
[2]   Brain Control of a Smart Wheelchair [J].
Blatt, Rossella ;
Ceriani, Simone ;
Dal Seno, Bernardo ;
Fontana, Giulio ;
Matteucci, Matteo ;
Migliore, Davide .
IAS-10: INTELLIGENT AUTONOMOUS SYSTEMS 10, 2008, :221-228
[3]   Brain-Controlled Wheelchairs A Robotic Architecture [J].
Carlson, Tom ;
Millan, Jose del R. .
IEEE ROBOTICS & AUTOMATION MAGAZINE, 2013, 20 (01) :65-73
[4]   TALKING OFF THE TOP OF YOUR HEAD - TOWARD A MENTAL PROSTHESIS UTILIZING EVENT-RELATED BRAIN POTENTIALS [J].
FARWELL, LA ;
DONCHIN, E .
ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1988, 70 (06) :510-523
[5]  
Ferracuti F, 2013, IEEE INT C INT ROBOT, P871, DOI 10.1109/IROS.2013.6696453
[6]   Comparison of Four Control Methods for a Five-Choice Assistive Technology [J].
Halder, Sebastian ;
Takano, Kouji ;
Kansaku, Kenji .
FRONTIERS IN HUMAN NEUROSCIENCE, 2018, 12
[7]   Natural stimuli improve auditory BCIs with respect to ergonomics and performance [J].
Hoehne, Johannes ;
Krenzlin, Konrad ;
Daehne, Sven ;
Tangermann, Michael .
JOURNAL OF NEURAL ENGINEERING, 2012, 9 (04)
[8]   P300 Brain-Computer Interface-Based Drone Control in Virtual and Augmented Reality [J].
Kim, Soram ;
Lee, Seungyun ;
Kang, Hyunsuk ;
Kim, Sion ;
Ahn, Minkyu .
SENSORS, 2021, 21 (17)
[9]   A comparison of classification techniques for the P300 Speller [J].
Krusienski, Dean J. ;
Sellers, Eric W. ;
Cabestaing, Francois ;
Bayoudh, Sabri ;
McFarland, Dennis J. ;
Vaughan, Theresa M. ;
Wolpaw, Jonathan R. .
JOURNAL OF NEURAL ENGINEERING, 2006, 3 (04) :299-305
[10]   Mixed reality-based brain computer interface system using an adaptive bandpass filter: Application to remote control of mobile manipulator [J].
Li, Qi ;
Sun, Meiqi ;
Song, Yu ;
Zhao, Di ;
Zhang, Tingjia ;
Zhang, Zhilin ;
Wu, Jinglong .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 83