Speech Imagery BCI Training Using Game with a Purpose

被引:0
|
作者
Selim, Abdulrahman Mohamed [1 ]
Rekrut, Maurice [1 ]
Barz, Michael [1 ,2 ]
Sonntag, Daniel [1 ,2 ]
机构
[1] German Res Ctr Artificial Intelligence DFKI, Saarbrucken, Germany
[2] Carl von Ossietzky Univ Oldenburg, Oldenburg, Germany
来源
PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ADVANCED VISUAL INTERFACES, AVI 2024 | 2024年
关键词
BCI; EEG; Imagined speech; Game with a purpose (GWAP); User study;
D O I
10.1145/3656650.3656654
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Games are used in multiple fields of brain-computer interface (BCI) research and applications to improve participants' engagement and enjoyment during electroencephalogram (EEG) data collection. However, despite potential benefits, no current studies have reported on implemented games for Speech Imagery BCI. Imagined speech is speech produced without audible sounds or active movement of the articulatory muscles. Collecting imagined speech EEG data is a time-consuming, mentally exhausting, and cumbersome process, which requires participants to read words off a computer screen and produce them as imagined speech. To improve this process for study participants, we implemented a maze-like game where a participant navigated a virtual robot capable of performing five actions that represented our words of interest while we recorded their EEG data. The study setup was evaluated with 15 participants. Based on their feedback, the game improved their engagement and enjoyment while resulting in a 69.10% average classification accuracy using a random forest classifier.
引用
收藏
页数:5
相关论文
共 50 条
  • [41] the application of BCI technology in android RPG game
    Yin, Jinghai
    Mu, Zhengdong
    Hu, Jianfeng
    FRONTIERS OF MANUFACTURING AND DESIGN SCIENCE IV, PTS 1-5, 2014, 496-500 : 2015 - 2018
  • [42] Mobile Robot Control by BCI Based on Motor Imagery
    Song, Wendi
    Wang, Xiangzhou
    Zheng, Shuhua
    Lin, Yingzi
    2014 SIXTH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC), VOL 2, 2014, : 383 - 387
  • [43] Multimodal Motor Imagery BCI Based on EEG and NIRS
    Ivaylov, Ivaylo
    Lazarova, Milena
    Manolova, Agata
    2021 56TH INTERNATIONAL SCIENTIFIC CONFERENCE ON INFORMATION, COMMUNICATION AND ENERGY SYSTEMS AND TECHNOLOGIES (ICEST), 2021, : 73 - 76
  • [44] Determining AR Order for BCI Based on Motor Imagery
    Lin, Suyun
    Guo, Shunying
    Huang, Zhihua
    2015 8TH INTERNATIONAL CONFERENCE ON BIOMEDICAL ENGINEERING AND INFORMATICS (BMEI), 2015, : 174 - 178
  • [45] To Assess the Influence of Artifacts on Motor Imagery Based BCI
    Chen, Yao
    Zhang, Chao
    Wu, Xiaopei
    2019 IEEE 4TH INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING (ICSIP 2019), 2019, : 925 - 929
  • [46] Auditory Imagery classification with a non-Invasive BCI
    Gonzalez, Melissa
    Yu, Lochi
    2016 IEEE 36TH CENTRAL AMERICAN AND PANAMA CONVENTION (CONCAPAN XXXVI), 2016,
  • [47] A Multi-Class BCI Based on Somatosensory Imagery
    Yao, Lin
    Mrachacz-Kersting, Natalie
    Sheng, Xinjun
    Zhu, Xiangyang
    Farina, Dario
    Jiang, Ning
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2018, 26 (08) : 1508 - 1515
  • [48] EEG-based motor imagery classification in BCI system by using unscented Kalman filter
    Aznan N.K.N.
    Huh K.-M.
    Yang Y.-M.
    Yang, Yeon-Mo (yangym@kumoh.ac.kr), 2016, Inderscience Enterprises Ltd., 29, route de Pre-Bois, Case Postale 856, CH-1215 Geneva 15, CH-1215, Switzerland (09) : 492 - 508
  • [49] Music versus motor imagery for BCI systems A study using fMRI and EEG: preliminary results
    Soriano, Diogo
    Silva, Elvis L.
    Slenes, Gabriel F.
    Lima, Fabricio O.
    Uribe, Luisa F. S.
    Coelho, Guilherme P.
    Rohmer, Eric
    Venancio, Thiago D.
    Beltramini, Guilherme C.
    Campos, Brunno M.
    Anjos, Carlos A. S.
    Suyama, Ricardo
    Li, Li M.
    Castellano, Gabriela
    Attux, Romis
    2013 ISSNIP BIOSIGNALS AND BIOROBOTICS CONFERENCE (BRC), 2013, : 151 - 156
  • [50] A BCI system for imagined Bengali speech recognition
    Hossain, Arman
    Das, Kathak
    Khan, Protima
    Kader, Md. Fazlul
    MACHINE LEARNING WITH APPLICATIONS, 2023, 13