Object Segmentation in Images using EEG Signals

被引:10
作者
Mohedano, Eva [1 ]
Healy, Graham [1 ]
McGuinness, Kevin [1 ]
Giro-i-Nieto, Xavier [2 ]
O'Connor, Noel E. [1 ]
Smeaton, Alan F. [1 ]
机构
[1] Dublin City Univ, Insight Ctr Data Analyt, Dublin 9, Ireland
[2] Univ Politecn Cataluna, Image Proc Grp, Barcelona, Spain
来源
PROCEEDINGS OF THE 2014 ACM CONFERENCE ON MULTIMEDIA (MM'14) | 2014年
基金
爱尔兰科学基金会;
关键词
Brain-computer interfaces; Electroencephalography; rapid serial visual presentation; Object segmentation; Interactive segmentation; GrabCut algorithm; BRAIN; SEARCH;
D O I
10.1145/2647868.2654896
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This paper explores the potential of brain-computer interfaces in segmenting objects from images. Our approach is centered around designing an effective method for displaying the image parts to the users such that they generate measurable brain reactions. When an image region, specifically a block of pixels, is displayed we estimate the probability of the block containing the object of interest using a score based on EEG activity. After several such blocks are displayed, the resulting probability map is binarized and combined with the GrabCut algorithm to segment the image into object and background regions. This study shows that BCI and simple EEG analysis are useful in locating object boundaries in images.
引用
收藏
页码:417 / 426
页数:10
相关论文
共 26 条
[1]  
ABDI AA, 2008, COMPUTER VISION PATT, P1
[2]  
[Anonymous], 2000, Opencv. Dr. Dobb's journal of software tools
[3]  
[Anonymous], P 1 IEEE WORKSH US C
[4]  
BAUER G, 1979, J NEUROL, V221, P77, DOI 10.1007/BF00313105
[5]   Control of a humanoid robot by a noninvasive brain-computer interface in humans [J].
Bell, Christian J. ;
Shenoy, Pradeep ;
Chalodhorn, Rawichote ;
Rao, Rajesh P. N. .
JOURNAL OF NEURAL ENGINEERING, 2008, 5 (02) :214-220
[6]  
Bergstra J., 2013, Making a Science of Model Search: Hyperparameter Optimization in Hundreds of Dimensions for Vision Architectures, P115
[7]  
Bergstra J, 2012, J MACH LEARN RES, V13, P281
[8]   Brain Activity-Based Image Classification From Rapid Serial Visual Presentation [J].
Bigdely-Shamlo, Nima ;
Vankov, Andrey ;
Ramirez, Rey R. ;
Makeig, Scott .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2008, 16 (05) :432-441
[9]   Bedside detection of awareness in the vegetative state: a cohort study [J].
Cruse, Damian ;
Chennu, Srivas ;
Chatelle, Camille ;
Bekinschtein, Tristan A. ;
Fernandez-Espejo, Davinia ;
Pickard, John D. ;
Laureys, Steven ;
Owen, Adrian M. .
LANCET, 2011, 378 (9809) :2088-2094
[10]   The Pascal Visual Object Classes (VOC) Challenge [J].
Everingham, Mark ;
Van Gool, Luc ;
Williams, Christopher K. I. ;
Winn, John ;
Zisserman, Andrew .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2010, 88 (02) :303-338