Projected Accuracy Metric for the P300 Speller

被引:10
作者
Colwell, Kenneth [1 ]
Throckmorton, Chandra [1 ]
Collins, Leslie [1 ]
Morton, Kenneth, Jr. [1 ]
机构
[1] Duke Univ, Dept Elect & Comp Engn, Durham, NC 27708 USA
基金
美国国家卫生研究院;
关键词
Brain-computer interface; performance metrics; P300; speller; BRAIN-COMPUTER-INTERFACE; PERFORMANCE; BCI;
D O I
10.1109/TNSRE.2014.2324892
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
The P300 Speller brain-computer interface (BCI) is a virtual keyboard that allows users to type without requiring neuromuscular control. P300 Speller research commonly aims to improve the system accuracy, which is typically estimated by spelling a small number of characters and calculating the percent spelled correctly. In this paper we introduce a new method for estimating the long-term ("projected") accuracy, which utilizes all available flash data and a probabilistic model of the Speller system to produce an estimate with lower variance and lower granularity than the standard measure. We apply the new method to 110 previously-collected P300 Speller runs to confirm its consistency, and simulate spelling runs from real subject data to demonstrate lower variance on the accuracy estimate for any given amount of data.
引用
收藏
页码:921 / 925
页数:5
相关论文
共 18 条
[1]  
[Anonymous], 1993, An introduction to the bootstrap
[2]   Performances evaluation and optimization of brain computer interface systems in a copy spelling task [J].
Bianchi, Luigi ;
Quitadamo, Lucia Rita ;
Garreffa, Girolamo ;
Cardarilli, Gian Carlo ;
Marciani, Maria Grazia .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2007, 15 (02) :207-216
[3]   The BCI competition 2003:: Progress and perspectives in detection and discrimination of EEG single trials [J].
Blankertz, B ;
Müller, KR ;
Curio, G ;
Vaughan, TM ;
Schalk, G ;
Wolpaw, JR ;
Schlögl, A ;
Neuper, C ;
Pfurtscheller, G ;
Hinterberger, T ;
Schröder, M ;
Birbaumer, N .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2004, 51 (06) :1044-1051
[4]   A COEFFICIENT OF AGREEMENT FOR NOMINAL SCALES [J].
COHEN, J .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1960, 20 (01) :37-46
[5]   The Utility Metric: A Novel Method to Assess the Overall Performance of Discrete Brain-Computer Interfaces [J].
Dal Seno, Bernardo ;
Matteucci, Matteo ;
Mainardi, Luca T. .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2010, 18 (01) :20-28
[6]   TALKING OFF THE TOP OF YOUR HEAD - TOWARD A MENTAL PROSTHESIS UTILIZING EVENT-RELATED BRAIN POTENTIALS [J].
FARWELL, LA ;
DONCHIN, E .
ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1988, 70 (06) :510-523
[7]   An auditory oddball (P300) spelling system for brain-computer interfaces [J].
Furdea, A. ;
Halder, S. ;
Krusienski, D. J. ;
Bross, D. ;
Nijboer, F. ;
Birbaumer, N. ;
Kuebler, A. .
PSYCHOPHYSIOLOGY, 2009, 46 (03) :617-625
[8]   Toward enhanced P300 speller performance [J].
Krusienski, D. J. ;
Sellers, E. W. ;
McFarland, D. J. ;
Vaughan, T. M. ;
Wolpaw, J. R. .
JOURNAL OF NEUROSCIENCE METHODS, 2008, 167 (01) :15-21
[9]   A comparison of classification techniques for the P300 Speller [J].
Krusienski, Dean J. ;
Sellers, Eric W. ;
Cabestaing, Francois ;
Bayoudh, Sabri ;
McFarland, Dennis J. ;
Vaughan, Theresa M. ;
Wolpaw, Jonathan R. .
JOURNAL OF NEURAL ENGINEERING, 2006, 3 (04) :299-305
[10]   Predictive Spelling With a P300-Based Brain-Computer Interface: Increasing the Rate of Communication [J].
Ryan, D. B. ;
Frye, G. E. ;
Townsend, G. ;
Berry, D. R. ;
Mesa-G, S. ;
Gates, N. A. ;
Sellers, E. W. .
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2011, 27 (01) :69-84