Novel Hybrid Brain-Computer Interface for Virtual Reality Applications Using Steady-State Visual-Evoked Potential-Based Brain-Computer Interface and Electrooculogram-Based Eye Tracking for Increased Information Transfer Rate

被引:10
作者
Ha, Jisoo [1 ]
Park, Seonghun [2 ]
Im, Chang-Hwan [1 ,2 ,3 ]
机构
[1] Hanyang Univ, Dept HY KIST Bioconvergence, Seoul, South Korea
[2] Hanyang Univ, Dept Elect Engn, Seoul, South Korea
[3] Hanyang Univ, Dept Biomed Engn, Seoul, South Korea
基金
新加坡国家研究基金会;
关键词
brain-computer interface; electroencephalogram; electrooculogram; virtual reality; steady state visual evoked potential; SSVEP;
D O I
10.3389/fninf.2022.758537
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Brain-computer interfaces (BCIs) based on electroencephalogram (EEG) have recently attracted increasing attention in virtual reality (VR) applications as a promising tool for controlling virtual objects or generating commands in a "hands-free" manner. Video-oculography (VOG) has been frequently used as a tool to improve BCI performance by identifying the gaze location on the screen, however, current VOG devices are generally too expensive to be embedded in practical low-cost VR head-mounted display (HMD) systems. In this study, we proposed a novel calibration-free hybrid BCI system combining steady-state visual-evoked potential (SSVEP)-based BCI and electrooculogram (EOG)-based eye tracking to increase the information transfer rate (ITR) of a nine-target SSVEP-based BCI in VR environment. Experiments were repeated on three different frequency configurations of pattern-reversal checkerboard stimuli arranged in a 3 x 3 matrix. When a user was staring at one of the nine visual stimuli, the column containing the target stimulus was first identified based on the user's horizontal eye movement direction (left, middle, or right) classified using horizontal EOG recorded from a pair of electrodes that can be readily incorporated with any existing VR-HMD systems. Note that the EOG can be recorded using the same amplifier for recording SSVEP, unlike the VOG system. Then, the target visual stimulus was identified among the three visual stimuli vertically arranged in the selected column using the extension of multivariate synchronization index (EMSI) algorithm, one of the widely used SSVEP detection algorithms. In our experiments with 20 participants wearing a commercial VR-HMD system, it was shown that both the accuracy and ITR of the proposed hybrid BCI were significantly increased compared to those of the traditional SSVEP-based BCI in VR environment.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] A Design of Brain-Computer Interface System for Steady-State Visual Evoked Potential Integrating Eye Movement Tracking and Target Dynamical Adjustment
    He L.
    Xie J.
    Yu H.
    Ren Z.
    Yang Y.
    Li M.
    Xu G.
    Hsi-An Chiao Tung Ta Hsueh/Journal of Xi'an Jiaotong University, 2021, 55 (10): : 87 - 95
  • [22] PERFORMANCE ESTIMATION OF A COOPERATIVE BRAIN-COMPUTER INTERFACE BASED ON THE DETECTION OF STEADY-STATE VISUAL EVOKED POTENTIALS
    Cecotti, Hubert
    Rivet, Bertrand
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [23] Brain-Computer Interface Based on Steady-State Visual Evoked Potential Using Quick-Response Code Pattern for Wheelchair Control
    Siribunyaphat, Nannaphat
    Punsawad, Yunyong
    SENSORS, 2023, 23 (04)
  • [24] Brain-Computer Interface Speller Based on Steady-State Visual Evoked Potential: A Review Focusing on the Stimulus Paradigm and Performance
    Li, Minglun
    He, Dianning
    Li, Chen
    Qi, Shouliang
    BRAIN SCIENCES, 2021, 11 (04)
  • [25] Steady-State Somato sensory Evoked Potential for Brain-Computer Interface Present and Future
    Ahn, Sangtae
    Kim, Kiwoong
    Jun, Sung Chan
    FRONTIERS IN HUMAN NEUROSCIENCE, 2016, 9
  • [26] Towards an independent brain-computer interface using steady state visual evoked potentials
    Allison, Brendan. Z.
    McFarland, Dennis J.
    Schalk, Gerwin
    Zheng, Shi Dong
    Jackson, Melody Moore
    Wolpaw, Jonathan R.
    CLINICAL NEUROPHYSIOLOGY, 2008, 119 (02) : 399 - 408
  • [27] Transient visual evoked potential -based method of detecting idle brain state in the event-related potential-based brain-computer interface
    Gong, Minghong
    Li, Mengfan
    Xu, Guizhi
    Lin, Fang
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 367 - 371
  • [28] Flexible boron-doped diamond spiral electrode for application in brain-computer interface based on steady-state visual evoked potential
    Yao, Yukun
    Sun, Yongyue
    Li, Hongji
    Xuan, Xiuwei
    Xu, Sheng
    Li, Mingji
    MEASUREMENT, 2023, 211
  • [29] Use of Phase in Brain-Computer Interfaces based on Steady-State Visual Evoked Potentials
    Lopez-Gordo, M. A.
    Prieto, A.
    Pelayo, F.
    Morillas, C.
    NEURAL PROCESSING LETTERS, 2010, 32 (01) : 1 - 9
  • [30] Objective evaluation of fatigue by EEG spectral analysis in steady-state visual evoked potential-based brain-computer interfaces
    Teng Cao
    Feng Wan
    Chi Man Wong
    Janir Nuno da Cruz
    Yong Hu
    BioMedical Engineering OnLine, 13