Human-in-the-loop active learning via brain computer interface

被引:0
作者
Eitan Netzer
Amir B. Geva
机构
[1] Ben-Gurion University,InnerEye Ltd and Department of Electrical and Computer Engineering
来源
Annals of Mathematics and Artificial Intelligence | 2020年 / 88卷
关键词
Deep learning; Human-In-The-Loop; Transfer Learning; Clustering; Brain Computer Interface; EEG; Active Learning;
D O I
暂无
中图分类号
学科分类号
摘要
This paper develops and examines an innovative methodology for training an artificial neural network to identify and tag target visual objects in a given database. While the field of Artificial Intelligence in general, and computer vision in particular, has greatly advanced in recent years, fast and efficient methods for tagging (i.e., labeling) visual targets are still lacking. Tagging data is important to train, as it allow to train supervised learning models. However, this is a tiresome task that often creates bottlenecks in academic and industrial research projects. In order to develop an algorithm that improves data tagging processes, this study utilizes the advantages of human cognition and machine learning by combining Brain Computer Interface, Human-In-The-Loop, and Deep Learning. Combining these three fields into one algorithm could enable the rapid annotation of large visual databases that have no prior references and cannot be described as a mathematical optimization function. Human-In-The-Loop is an increasingly researched area that refers to the integration of human feedback in computation processes. At present, computer-based deep learning can only be incorporated in the process of identifying and tagging target objects of interest if a predefined database exists – one that has already been defined by a human user. To reduce the scope of this timely and costly process, our algorithm uses machine learning techniques (i.e., active learning) to minimize the number of target objects a human user needs to identify before the computer can successfully carry out the task independently. In our method, users are connected to electroencephalograms electrodes and shown images using rapid serial visual presentation – a fast method for presenting users with images. Some images are target objects, while others are not. Based on users’ brainwave activity when target objects are shown, the computer learns to identify and tag target objects – already in the learning stage (unlike naïve uniform sampling methods that first require human input, and only then begin the learning stage). As such, our work is proof of concept for the effectiveness of involving humans in the computer’s learning stage, i.e., human-in-the-loop as opposed to the traditional method of humans first tagging the data and the machines then learning and creating a model.
引用
收藏
页码:1191 / 1205
页数:14
相关论文
共 46 条
[1]  
Schirner G(2013)The future of human-in-the-loop cyber-physical systems Computer 46 36-45
[2]  
Erdogmus D(2014)Spatiotemporal representations of rapid visual target detection: A single-trial EEG classification algorithm IEEE Transactions on Biomedical Engineering 61 2290-2303
[3]  
Chowdhury K(2015)Convolutional neural network for multi-category rapid serial visual presentation bci Frontiers in computational neuroscience 9 146-478
[4]  
Padir T(2010)In a blink of an eye and a switch of a transistor: cortically coupled computer vision Proceedings of the IEEE 98 462-179
[5]  
Alpert GF(2015)Deep learning nature 521 436-252
[6]  
Manor R(1986)Learning representations by back-propagating errors nature 323 533-795
[7]  
Spanier AB(2006)Cortically coupled computer vision for rapid image search IEEE Transactions on neural systems and rehabilitation engineering 14 174-374
[8]  
Deouell LY(2015)Imagenet large scale visual recognition challenge International Journal of Computer Vision 115 211-2148
[9]  
Geva AB(1977)Augmenting mental chronometry: the p300 as a measure of stimulus evaluation time Science 197 792-undefined
[10]  
Manor R(1988)Is the p300 component a manifestation of context updating? Behavioral and brain sciences 11 357-undefined