Deep learning helps EEG signals predict different stages of visual processing in the human brain

被引:8
作者
Mathur, Nalin [1 ]
Gupta, Anubha [2 ]
Jaswal, Snehlata [3 ]
Verma, Rohit [4 ]
机构
[1] Netaji Subhas Univ Technol, New Delhi, India
[2] IIIT Delhi, SBILab, Dept ECE, New Delhi 110020, India
[3] Chaudhary Charan Singh Univ, Dept Psychol, Meerut, Uttar Pradesh, India
[4] All India Inst Med Sci, Dept Psychol, New Delhi 110029, India
关键词
EEG; Visual feature binding; Visual working memory; Visual processing; Convolutional neural network; MEMORY BINDING DEFICITS; WORKING-MEMORY; STORAGE CAPACITY; FEATURES; INFORMATION; ATTENTION; MODEL; TIME; CONJUNCTIONS; INTEGRATION;
D O I
10.1016/j.bspc.2021.102996
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Analysis of electroencephalogram (EEG) signals to determine the nature of visual stimuli, being experienced by a person, is an active area of research. It is key to understand the link between human brain and behavior, especially for brain computer interface (BCI) applications and rehabilitation of patients suffering with neurological disorders. In this research, we conducted an experiment comparing two stages of visual processing, determined distinct EEG signals associated with them, and subsequently used a classifier to distinguish the two stages. EEG data was collected using a feature-binding experiment that required subjects to detect changes in color and shape binding after 100 ms and after 1500 ms. The two stages denoted by these study-test intervals were determined using features extracted from both time and frequency domains. These were used to separately train various machine learning classifiers. The time-frequency domain representation of the signal was used to train a convolutional neural network (CNN). Promising results were obtained. Thus, the contribution of the paper is two-fold. Firstly, we carry out EEG data analysis using deep learning to classify whether the EEG trial belongs to 100 ms class or 1500 ms class. Secondly, we connect these results to predict different stages of visual processing in human brain and visual feature binding. Thus, deep learning can help us predict the stages of visual processing and, hence, unlock important insights regarding the temporal dynamics of brain functioning. This can help in building relevant tools for BCI applications such as neuro-rehabilitation of subjects suffering impairments in visual feature binding.
引用
收藏
页数:12
相关论文
共 83 条
[1]   Automated neonatal seizure detection: A multistage classification system through feature selection basedon relevance and redundancy analysis [J].
Aarabi, A ;
Wallois, F ;
Grebe, R .
CLINICAL NEUROPHYSIOLOGY, 2006, 117 (02) :328-340
[2]   Brain-Computer Interface for Control of Wheelchair Using Fuzzy Neural Networks [J].
Abiyev, Rahib H. ;
Akkaya, Nurullah ;
Aytac, Ersin ;
Gunsel, Irfan ;
Cagman, Ahmet .
BIOMED RESEARCH INTERNATIONAL, 2016, 2016
[3]  
Alvarez G, 2007, VIS COGN, V15, P70
[4]   Overwriting and rebinding: Why feature-switch detection tasks underestimate the binding capacity of visual working memory [J].
Alvarez, George A. ;
Thompson, Todd W. .
VISUAL COGNITION, 2009, 17 (1-2) :141-159
[5]  
[Anonymous], 2015, ACS SYM SER
[6]  
Anwar D, 2018, INT CONF COMMUN SYST, P705, DOI 10.1109/COMSNETS.2018.8328299
[7]   Alpha, beta and gamma electrocorticographic rhythms in somatosensory, motor, premotor and prefrontal cortical areas differ in movement execution and observation in humans [J].
Babiloni, Claudio ;
Del Percio, Claudio ;
Vecchio, Fabrizio ;
Sebastiano, Fabio ;
Di Gennaro, Giancarlo ;
Quarato, Pier P. ;
Morace, Roberta ;
Pavone, Luigi ;
Soricelli, Andrea ;
Noce, Giuseppe ;
Esposito, Vincenzo ;
Rossini, Paolo Maria ;
Gallese, Vittorio ;
Mirabella, Giovanni .
CLINICAL NEUROPHYSIOLOGY, 2016, 127 (01) :641-654
[8]  
Bahri Z, 2014, 2014 WORLD SYMPOSIUM ON COMPUTER APPLICATIONS & RESEARCH (WSCAR)
[9]   Time constraints and resource sharing in adults' working memory spans [J].
Barrouillet, P ;
Bernardin, S ;
Camos, V .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 2004, 133 (01) :83-100
[10]  
Barrouillet P., 2007, COGNITIVE NEUROSCIEN, P59, DOI [10.1093/ acprof:oso/9780198570394.003.0004, DOI 10.1093/ACPROF:OSO/9780198570394.003.0004]