Visual tracking brain-computer interface

被引:4
作者
Huang, Changxing [1 ]
Shi, Nanlin [1 ]
Miao, Yining [1 ]
Chen, Xiaogang [2 ]
Wang, Yijun [3 ]
Gao, Xiaorong [1 ]
机构
[1] Tsinghua Univ, Sch Med, Dept Biomed Engn, Beijing 100084, Peoples R China
[2] Chinese Acad Med Sci & Peking Union Med Coll, Inst Biomed Engn, Tianjin 300192, Peoples R China
[3] Chinese Acad Sci, Inst Semicond, State Key Lab Integrated Optoelect, Beijing 100083, Peoples R China
基金
中国国家自然科学基金;
关键词
SSVEP-BCI; CURSOR CONTROL; EYE TRACKING; SPEED; PERFORMANCE; FREQUENCY; COMMUNICATION; PROSTHESIS; IMAGERY; SYSTEM;
D O I
10.1016/j.isci.2024.109376
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Brain -computer interfaces (BCIs) offer a way to interact with computers without relying on physical movements. Non-invasive electroencephalography-based visual BCIs, known for efficient speed and calibration ease, face limitations in continuous tasks due to discrete stimulus design and decoding methods. To achieve continuous control, we implemented a novel spatial encoding stimulus paradigm and devised a corresponding projection method to enable continuous modulation of decoded velocity. Subsequently, we conducted experiments involving 17 participants and achieved Fitt's information transfer rate (ITR) of 0.55 bps for the fixed tracking task and 0.37 bps for the random tracking task. The proposed BCI with a high Fitt's ITR was then integrated into two applications, including painting and gaming. In conclusion, this study proposed a visual BCI based -control method to go beyond discrete commands, allowing natural continuous control based on neural activity.
引用
收藏
页数:15
相关论文
共 43 条
[31]   Imagery of motor actions: Differential effects of kinesthetic and visual-motor mode of imagery in single-trial EEG [J].
Neuper, C ;
Scherer, R ;
Reiner, M ;
Pfurtscheller, G .
COGNITIVE BRAIN RESEARCH, 2005, 25 (03) :668-677
[32]   High performance communication by people with paralysis using an intracortical brain-computer interface [J].
Pandarinath, Chethan ;
Nuyujukian, Paul ;
Blabe, Christine H. ;
Sorice, Brittany L. ;
Saab, Jad ;
Willett, Francis R. ;
Hochberg, Leigh R. ;
Shenoy, Krishna V. ;
Henderson, Jaimie M. .
ELIFE, 2017, 6
[33]   Motor imagery and direct brain-computer communication [J].
Pfurtscheller, G ;
Neuper, C .
PROCEEDINGS OF THE IEEE, 2001, 89 (07) :1123-1134
[34]   Estimating and approaching the maximum information rate of noninvasive visual brain-computer interface [J].
Shi, Nanlin ;
Miao, Yining ;
Huang, Changxing ;
Li, Xiang ;
Song, Yonghao ;
Chen, Xiaogang ;
Wang, Yijun ;
Gao, Xiaorong .
NEUROIMAGE, 2024, 289
[35]   Plug-and-play control of a brain-computer interface through neural map stabilization [J].
Silversmith, Daniel B. ;
Abiri, Reza ;
Hardy, Nicholas F. ;
Natraj, Nikhilesh ;
Tu-Chan, Adelyn ;
Chang, Edward F. ;
Ganguly, Karunesh .
NATURE BIOTECHNOLOGY, 2021, 39 (03) :326-+
[36]  
Spüler M, 2015, IEEE ENG MED BIO, P1087, DOI 10.1109/EMBC.2015.7318554
[37]   THE BRAIN RESPONSE INTERFACE - COMMUNICATION THROUGH VISUALLY-INDUCED ELECTRICAL BRAIN RESPONSES [J].
SUTTER, EE .
JOURNAL OF MICROCOMPUTER APPLICATIONS, 1992, 15 (01) :31-45
[38]   Computational neuroimaging and population receptive fields [J].
Wendell, Brian A. ;
Winawer, Jonathan .
TRENDS IN COGNITIVE SCIENCES, 2015, 19 (06) :349-357
[39]   A high-performance speech neuroprosthesis [J].
Willett, Francis R. ;
Kunz, Erin M. ;
Fan, Chaofei ;
Avansino, Donald T. ;
Wilson, Guy H. ;
Choi, Eun Young ;
Kamdar, Foram ;
Glasser, Matthew F. ;
Hochberg, Leigh R. ;
Druckmann, Shaul ;
Shenoy, Krishna V. ;
Henderson, Jaimie M. .
NATURE, 2023, 620 (7976) :1031-1036
[40]   High-performance brain-to-text communication via handwriting [J].
Willett, Francis R. ;
Avansino, Donald T. ;
Hochberg, Leigh R. ;
Henderson, Jaimie M. ;
Shenoy, Krishna V. .
NATURE, 2021, 593 (7858) :249-+