Study on Robot Grasping System of SSVEP-BCI Based on Augmented Reality Stimulus

被引:23
作者
Zhang, Shangen [1 ]
Chen, Yuanfang [2 ]
Zhang, Lijian [2 ]
Gao, Xiaorong [3 ]
Chen, Xiaogang [4 ]
机构
[1] Univ Sci & Technol Beijing, Sch Comp & Commun Engn, Beijing 100083, Peoples R China
[2] Beijing Inst Mech Equipment, Beijing 100854, Peoples R China
[3] Tsinghua Univ, Sch Med, Dept Biomed Engn, Beijing 100084, Peoples R China
[4] Chinese Acad Med Sci & Peking Union Med Coll, Inst Biomed Engn, Tianjin 300192, Peoples R China
来源
TSINGHUA SCIENCE AND TECHNOLOGY | 2023年 / 28卷 / 02期
关键词
Visualization; Grasping; Liquid crystal displays; Brain-computer interfaces; Steady-state; Reliability; Task analysis; Steady-State Visual Evoked Potential (SSVEP); Brain-Computer Interface (BCI); Augmented Reality (AR); robot; grasping system; BRAIN-COMPUTER-INTERFACE;
D O I
10.26599/TST.2021.9010085
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Although notable progress has been made in the study of Steady-State Visual Evoked Potential (SSVEP)-based Brain-Computer Interface (BCI), several factors that limit the practical applications of BCIs still exist. One of these factors is the importability of the stimulator. In this study, Augmented Reality (AR) technology was introduced to present the visual stimuli of SSVEP-BCI, while the robot grasping experiment was designed to verify the applicability of the AR-BCI system. The offline experiment was designed to determine the best stimulus time, while the online experiment was used to complete the robot grasping task. The offline experiment revealed that better information transfer rate performance could be achieved when the stimulation time is 2 s. Results of the online experiment indicate that all 12 subjects could control the robot to complete the robot grasping task, which indicates the applicability of the AR-SSVEP-humanoid robot (NAO) system. This study verified the reliability of the AR-BCI system and indicated the applicability of the AR-SSVEP-NAO system in robot grasping tasks.
引用
收藏
页码:322 / 329
页数:8
相关论文
共 20 条
[1]   Wearable Brain-Computer Interface Instrumentation for Robot-Based Rehabilitation by Augmented Reality [J].
Arpaia, Pasquale ;
Duraccio, Luigi ;
Moccaldi, Nicola ;
Rossi, Silvia .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (09) :6362-6371
[2]   An online multi-channel SSVEP-based brain-computer interface using a canonical correlation analysis method [J].
Bin, Guangyu ;
Gao, Xiaorong ;
Yan, Zheng ;
Hong, Bo ;
Gao, Shangkai .
JOURNAL OF NEURAL ENGINEERING, 2009, 6 (04)
[3]   Toward Brain-Actuated Humanoid Robots: Asynchronous Direct Control Using an EEG-Based BCI [J].
Chae, Yongwook ;
Jeong, Jaeseung ;
Jo, Sungho .
IEEE TRANSACTIONS ON ROBOTICS, 2012, 28 (05) :1131-1144
[4]   Combination of Augmented Reality Based Brain- Computer Interface and Computer Vision for High-Level Control of a Robotic Arm [J].
Chen, Xiaogang ;
Huang, Xiaoshan ;
Wang, Yijun ;
Gao, Xiaorong .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (12) :3140-3147
[5]   High-speed spelling with a noninvasive brain-computer interface [J].
Chen, Xiaogang ;
Wang, Yijun ;
Nakanishi, Masaki ;
Gao, Xiaorong ;
Jung, Tzyy-Ping ;
Gao, Shangkai .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2015, 112 (44) :E6058-E6067
[6]   Filter bank canonical correlation analysis for implementing a high-speed SSVEP-based brain-computer interface [J].
Chen, Xiaogang ;
Wang, Yijun ;
Gao, Shangkai ;
Jung, Tzyy-Ping ;
Gao, Xiaorong .
JOURNAL OF NEURAL ENGINEERING, 2015, 12 (04)
[7]   Design of a Multimodal EEG-based Hybrid BCI System with Visual Servo Module [J].
Duan, Feng ;
Lin, Dongxue ;
Li, Wenyu ;
Zhang, Zhao .
IEEE TRANSACTIONS ON AUTONOMOUS MENTAL DEVELOPMENT, 2015, 7 (04) :332-341
[8]   Channel Projection-Based CCA Target Identification Method for an SSVEP-Based BCI System of Quadrotor Helicopter Control [J].
Gao, Qiang ;
Zhang, Yuxin ;
Wang, Zhe ;
Dong, Enzeng ;
Song, Xiaolin ;
Song, Yu .
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2019, 2019
[9]   Visual and Auditory Brain-Computer Interfaces [J].
Gao, Shangkai ;
Wang, Yijun ;
Gao, Xiaorong ;
Hong, Bo .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2014, 61 (05) :1436-1447
[10]  
Hawley L, 2017, IEEE INT C INT ROBOT, P4997, DOI 10.1109/IROS.2017.8206382