Speech Imagery BCI Training Using Game with a Purpose

被引:0
|
作者
Selim, Abdulrahman Mohamed [1 ]
Rekrut, Maurice [1 ]
Barz, Michael [1 ,2 ]
Sonntag, Daniel [1 ,2 ]
机构
[1] German Res Ctr Artificial Intelligence DFKI, Saarbrucken, Germany
[2] Carl von Ossietzky Univ Oldenburg, Oldenburg, Germany
来源
PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ADVANCED VISUAL INTERFACES, AVI 2024 | 2024年
关键词
BCI; EEG; Imagined speech; Game with a purpose (GWAP); User study;
D O I
10.1145/3656650.3656654
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Games are used in multiple fields of brain-computer interface (BCI) research and applications to improve participants' engagement and enjoyment during electroencephalogram (EEG) data collection. However, despite potential benefits, no current studies have reported on implemented games for Speech Imagery BCI. Imagined speech is speech produced without audible sounds or active movement of the articulatory muscles. Collecting imagined speech EEG data is a time-consuming, mentally exhausting, and cumbersome process, which requires participants to read words off a computer screen and produce them as imagined speech. To improve this process for study participants, we implemented a maze-like game where a participant navigated a virtual robot capable of performing five actions that represented our words of interest while we recorded their EEG data. The study setup was evaluated with 15 participants. Based on their feedback, the game improved their engagement and enjoyment while resulting in a 69.10% average classification accuracy using a random forest classifier.
引用
收藏
页数:5
相关论文
共 50 条
  • [1] Design of a BCI Controlled Serious Game for Concentration Training
    Garcia-Agundez, Augusto
    Dobermann, Eduard
    Gobel, Stefan
    SERIOUS GAMES, JCSG 2018, 2018, 11243 : 169 - 174
  • [2] Analysis and classification of hybrid BCI based on motor imagery and speech imagery
    Wang, Li
    Liu, Xiaochu
    Liang, Zhongwei
    Yang, Zhao
    Hu, Xiao
    MEASUREMENT, 2019, 147
  • [3] Active training paradigm for motor imagery BCI
    Li, Junhua
    Zhang, Liqing
    EXPERIMENTAL BRAIN RESEARCH, 2012, 219 (02) : 245 - 254
  • [4] Neural Decoding of Imagined Speech and Visual Imagery as Intuitive Paradigms for BCI Communication
    Lee, Seo-Hyun
    Lee, Minji
    Lee, Seong-Whan
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (12) : 2647 - 2659
  • [5] Transcranial Direct-Current Stimulation Effect on a Speech-Imagery-based BCI
    Kaongoen, Netiwit
    Choi, Jaehoon
    Jo, Sungho
    2021 9TH IEEE INTERNATIONAL WINTER CONFERENCE ON BRAIN-COMPUTER INTERFACE (BCI), 2021, : 100 - 104
  • [6] Stimulus Effects on Subject-Specific BCI Classification Training using Motor Imagery
    Miloulis, Stavros Theofanis
    Kakkos, Ioannis
    Karampasi, Aikaterini
    Zorzos, Ioannis
    Ventouras, Errikos-Chaim
    Matsopoulos, George K.
    Asvestas, Panteleimon
    Kalatzis, Ioannis
    2021 INTERNATIONAL CONFERENCE ON E-HEALTH AND BIOENGINEERING (EHB 2021), 9TH EDITION, 2021,
  • [7] Two Brains, One Game: Design and Evaluation of a Multiuser BCI Video Game Based on Motor Imagery
    Bonnet, Laurent
    Lotte, Fabien
    Lecuyer, Anatole
    IEEE TRANSACTIONS ON COMPUTATIONAL INTELLIGENCE AND AI IN GAMES, 2013, 5 (02) : 185 - 198
  • [8] Asynchronous BCI Based on Motor Imagery With Automated Calibration and Neurofeedback Training
    Kus, Rafal
    Valbuena, Diana
    Zygierewicz, Jaroslaw
    Malechka, Tatsiana
    Graeser, Axel
    Durka, Piotr
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2012, 20 (06) : 823 - 835
  • [9] Developing and evaluating a BCI video game for neurofeedback training: the case of autism
    Jose Mercado
    Ismael Espinosa-Curiel
    Lizbeth Escobedo
    Monica Tentori
    Multimedia Tools and Applications, 2019, 78 : 13675 - 13712
  • [10] Developing and evaluating a BCI video game for neurofeedback training: the case of autism
    Mercado, Jose
    Espinosa-Curiel, Ismael
    Escobedo, Lizbeth
    Tentori, Monica
    MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (10) : 13675 - 13712