Brain-Controlled 2D Navigation Robot Based on a Spatial Gradient Controller and Predictive Environmental Coordinator

被引:9
作者
Zhang, Deyu [1 ]
Liu, Siyu [1 ]
Zhang, Jian [1 ]
Li, Guoqi [1 ]
Suo, Dingjie [1 ]
Liu, Tiantian [1 ]
Luo, Jiawei [1 ]
Ming, Zhiyuan [1 ]
Wu, Jinglong [1 ]
Yan, Tianyi [1 ]
机构
[1] Beijing Inst Technol, Beijing 100081, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Brain-computer interfaces; robot control; human-machine shared control; COMPUTER-INTERFACE; SSVEP; WHEELCHAIR;
D O I
10.1109/JBHI.2022.3219812
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Objective: Brain-computer interfaces (BCIs) have been used in two-dimensional (2D) navigation robotic devices, such as brain-controlled wheelchairs and brain-controlled vehicles. However, contemporary BCI systems are driven by binary selective control. On the one hand, only directional information can be transferred from humans to machines, such as "turn left " or "turn right ", which means that the quantified value, such as the radius of gyration, cannot be controlled. In this study, we proposed a spatial gradient BCI controller and corresponding environment coordinator, by which the quantified value of brain commands can be transferred in the form of a 2D vector, improving the flexibility, stability and efficiency of BCIs. Methods: A horizontal array of steady-state visual stimulation was arranged to excite subject (EEG) signals. Covariance arrays between subjects' electroencephalogram (EEG) and stimulation features were mapped into quantified 2-dimensional vectors. The generated vectors were then inputted into the predictive controller and fused with virtual forces generated by the robot's predictive environment coordinator in the form of vector calculation. The resultant vector was then interpreted into the driving force for the robot, and real-time speed feedback was generated. Results: The proposed SGC controller generated a faster (27.4 s vs. 34.9 s) response for the single-obstacle avoidance task than the selective control approach. In practical multiobstacle tasks, the proposed robot executed 39% faster in the target-reaching tasks than the selective controller and had better robustness in multiobstacle avoidance tasks (average failures significantly dropped from 27% to 4%). Significance: This research proposes a new form of brain-machine shared control strategy that quantifies brain commands in the form of a 2-D control vector stream rather than selective constant values. Combined with a predictive environment coordinator, the brain-controlled strategy of the robot is optimized and provided with higher flexibility. The proposed controller can be used in brain-controlled 2D navigation devices, such as brain-controlled wheelchairs and vehicles.
引用
收藏
页码:6138 / 6149
页数:12
相关论文
共 33 条
  • [1] An Y, 2017, INT CONF SYST INFORM, P594, DOI 10.1109/ICSAI.2017.8248359
  • [2] Optimizing Spatial Filters by Minimizing Within-Class Dissimilarities in Electroencephalogram-Based Brain-Computer Interface
    Arvaneh, Mahnaz
    Guan, Cuntai
    Ang, Kai Keng
    Quek, Chai
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2013, 24 (04) : 610 - 619
  • [3] A Self-Paced and Calibration-Less SSVEP-Based Brain-Computer Interface Speller
    Cecotti, Hubert
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2010, 18 (02) : 127 - 133
  • [4] Filter bank canonical correlation analysis for implementing a high-speed SSVEP-based brain-computer interface
    Chen, Xiaogang
    Wang, Yijun
    Gao, Shangkai
    Jung, Tzyy-Ping
    Gao, Xiaorong
    [J]. JOURNAL OF NEURAL ENGINEERING, 2015, 12 (04)
  • [5] A Bayesian Shared Control Approach for Wheelchair Robot With Brain Machine Interface
    Deng, Xiaoyan
    Yu, Zhu Liang
    Lin, Canguang
    Gu, Zhenghui
    Li, Yuanqing
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (01) : 328 - 338
  • [6] Human-prosthesis coordination: A preliminary study exploring coordination with a powered ankle-foot prosthesis
    Fylstra, Bretta L.
    Lee, I-Chieh
    Huang, Stephanie
    Brandt, Andrea
    Lewek, Michael D.
    Huang, He
    [J]. CLINICAL BIOMECHANICS, 2020, 80
  • [7] SSVEP-Based Brain-Computer Interface With a Limited Number of Frequencies Based on Dual-Frequency Biased Coding
    Ge, Sheng
    Jiang, Yichuan
    Zhang, Mingming
    Wang, Ruimin
    Iramina, Keiji
    Lin, Pan
    Leng, Yue
    Wang, Haixian
    Zheng, Wenming
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2021, 29 : 760 - 769
  • [8] MEG and EEG data analysis with MNE-Python']Python
    Gramfort, Alexandre
    Luessi, Martin
    Larson, Eric
    Engemann, Denis A.
    Strohmeier, Daniel
    Brodbeck, Christian
    Goj, Roman
    Jas, Mainak
    Brooks, Teon
    Parkkonen, Lauri
    Haemaelaeinen, Matti
    [J]. FRONTIERS IN NEUROSCIENCE, 2013, 7
  • [9] MNE software for processing MEG and EEG data
    Gramfort, Alexandre
    Luessi, Martin
    Larson, Eric
    Engemann, Denis A.
    Strohmeier, Daniel
    Brodbeck, Christian
    Parkkonen, Lauri
    Haemaelaeinen, Matti S.
    [J]. NEUROIMAGE, 2014, 86 : 446 - 460
  • [10] Guger C, 2017, SPRBRIEF ELECT, P1, DOI 10.1007/978-3-319-64373-1_1