A passive BCI for monitoring the intentionality of the gaze-based moving object selection

被引:11
作者
Zhao, Darisy G. [1 ]
Vasilyev, Anatoly N. [1 ,2 ,3 ]
Kozyrskiy, Bogdan L. [1 ,4 ]
Melnichuk, Eugeny, V [1 ]
Isachenko, Andrey, V [1 ,5 ]
Velichkovsky, Boris M. [1 ,5 ]
Shishkin, Sergei L. [1 ,3 ]
机构
[1] NRC Kurchatov Inst, Lab Neurocognit Technol, Moscow, Russia
[2] Moscow MV Lomonosov State Univ, Lab Neurophysiol & Neurocomp Interfaces, Moscow, Russia
[3] Moscow State Univ Psychol & Educ, MEG Ctr, Moscow, Russia
[4] EURECOM, Dept Data Sci, Biot, France
[5] Moscow Inst Phys & Technol, Inst NBCIS S&T, Moscow, Russia
基金
俄罗斯科学基金会;
关键词
brain– computer interface; gaze interaction; E-wave; contingent negative variation; stimulus preceding negativity; smooth pursuit eye movement; selection; BRAIN-COMPUTER INTERFACE; FIXATION-RELATED POTENTIALS; EYE-MOVEMENTS; VISUAL-SEARCH; EEG; REWARD; CLASSIFICATION; COMPONENT; DYNAMICS; TARGET;
D O I
10.1088/1741-2552/abda09
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. The use of an electroencephalogram (EEG) anticipation-related component, the expectancy wave (E-wave), in brain-machine interaction was proposed more than 50 years ago. This possibility was not explored for decades, but recently it was shown that voluntary attempts to select items using eye fixations, but not spontaneous eye fixations, are accompanied by the E-wave. Thus, the use of the E-wave detection was proposed for the enhancement of gaze interaction technology, which has a strong need for a mean to decide if a gaze behavior is voluntary or not. Here, we attempted at estimating whether this approach can be used in the context of moving object selection through smooth pursuit eye movements. Approach. Eighteen participants selected, one by one, items which moved on a computer screen, by gazing at them. In separate runs, the participants performed tasks not related to voluntary selection but also provoking smooth pursuit. A low-cost consumer-grade eye tracker was used for item selection. Main results. A component resembling the E-wave was found in the averaged EEG segments time-locked to voluntary selection events of every participant. Linear discriminant analysis with shrinkage regularization classified the intentional and spontaneous smooth pursuit eye movements, using single-trial 300 ms long EEG segments, significantly above chance in eight participants. When the classifier output was averaged over ten subsequent data segments, median group ROC AUC of 0.75 was achieved. Significance. The results suggest the possible usefulness of the E-wave detection in the gaze-based selection of moving items, e.g. in video games. This technique might be more effective when trial data can be averaged, thus it could be considered for use in passive interfaces, for example, in estimating the degree of the user's involvement during gaze-based interaction.
引用
收藏
页数:18
相关论文
共 70 条
[1]   Oculomotor inhibition reflects temporal expectations [J].
Amit, Roy ;
Abeles, Dekel ;
Carrasco, Marisa ;
Yuval-Greenberg, Shlomit .
NEUROIMAGE, 2019, 184 :279-292
[2]   Performance of a Steady-State Visual Evoked Potential and Eye Gaze Hybrid Brain-Computer Interface on Participants With and Without a Brain Injury [J].
Brennan, Chris ;
McCullagh, Paul ;
Lightbody, Gaye ;
Galway, Leo ;
McClean, Sally ;
Stawicki, Piotr ;
Gembler, Felix ;
Volosyak, Ivan ;
Armstrong, Elaine ;
Thompson, Eileen .
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2020, 50 (04) :277-286
[3]   Effects of Reward on the Accuracy and Dynamics of Smooth Pursuit Eye Movements [J].
Brielmann, Aenne A. ;
Spering, Miriam .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 2015, 41 (04) :917-928
[4]   Distinguishing between target and nontarget fixations in a visual search task using fixation-related potentials [J].
Brouwer, Anne-Marie ;
Reuderink, Boris ;
Vincent, Joris ;
van Gerven, Marcel A. J. ;
van Erp, Jan B. F. .
JOURNAL OF VISION, 2013, 13 (03) :17
[5]   Wait and see [J].
Brunia, CHM ;
van Boxtel, GJM .
INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2001, 43 (01) :59-75
[6]   MOVEMENT AND STIMULUS PRECEDING NEGATIVITY [J].
BRUNIA, CHM .
BIOLOGICAL PSYCHOLOGY, 1988, 26 (1-3) :165-178
[7]   Waiting to perceive: Reward or punishment? [J].
Brunia, Cornelis H. M. ;
Hackley, Steven A. ;
van Boxtel, Geert J. M. ;
Kotani, Yasunori ;
Ohgami, Yoshimi .
CLINICAL NEUROPHYSIOLOGY, 2011, 122 (05) :858-868
[8]  
Bulling A., 2013, P 26 ANN ACM S US IN, P261, DOI 10.1145/2501988.2501998
[9]   Attention is allocated closely ahead of the target during smooth pursuit eye movements: Evidence from EEG frequency tagging [J].
Chen, Jing ;
Valsecchi, Matteo ;
Gegenfurtner, Karl R. .
NEUROPSYCHOLOGIA, 2017, 102 :206-216
[10]  
Cymek DH, 2014, J EYE MOVEMENT RES, V7