A Bidirectional Brain-Machine Interface Featuring a Neuromorphic Hardware Decoder

被引:56
作者
Boi, Fabio [1 ]
Moraitis, Timoleon [2 ,3 ]
De Feo, Vito [1 ]
Diotalevi, Francesco [4 ]
Bartolozzi, Chiara [5 ]
Indiveri, Giacomo [2 ,3 ]
Vato, Alessandro [1 ]
机构
[1] Ist Italiano Tecnol, Neural Computat Lab, Rovereto, Italy
[2] Univ Zurich, Inst Neuroinformat, Zurich, Switzerland
[3] Swiss Fed Inst Technol, Zurich, Switzerland
[4] Ist ItalianoTecnol, Robot Brain & Cognit Sci, Genoa, Italy
[5] Ist ItalianoTecnol, ICub Facil, Genoa, Italy
基金
欧洲研究理事会;
关键词
bidirectional BMI; neuromorphic decoder; on-line learning; modular system; spiking neural network; INTRACORTICAL MICROSTIMULATION; COMPUTER INTERFACES; MOVEMENT; CIRCUITS; WORLD; RAT;
D O I
10.3389/fnins.2016.00563
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Bidirectional brain-machine interfaces (BMIs) establish a two-way direct communication link between the brain and the external world. A decoder translates recorded neural activity into motor commands and an encoder delivers sensory information collected from the environment directly to the brain creating a closed-loop system. These two modules are typically integrated in bulky external devices. However, the clinical support of patients with severe motor and sensory deficits requires compact, low-power, and fully implantable systems that can decode neural signals to control external devices. As a first step toward this goal, we developed a modular bidirectional BMI setup that uses a compact neuromorphic processor as a decoder. On this chip we implemented a network of spiking neurons built using its ultra-low-power mixed-signal analog/digital circuits. On-chip on-line spike-timing-dependent plasticity synapse circuits enabled the network to learn to decode neural signals recorded from the brain into motor outputs controlling the movements of an external device. The modularity of the BMI allowed us to tune the individual components of the setup without modifying the whole system. In this paper, we present the features of this modular BMI and describe how we configured the network of spiking neuron circuits to implement the decoder and to coordinate it with the encoder in an experimental BMI paradigm that connects bidirectionally the brain of an anesthetized rat with an external object. We show that the chip learned the decoding task correctly, allowing the interfaced brain to control the object's trajectories robustly. Based on our demonstration, we propose that neuromorphic technology is mature enough for the development of BMI modules that are sufficiently low-power and compact, while being highly computationally powerful and adaptive.
引用
收藏
页数:15
相关论文
共 46 条
[1]   A programmable closed-loop recording and stimulating wireless system for behaving small laboratory animals [J].
Angotzi, Gian Nicola ;
Boi, Fabio ;
Zordan, Stefano ;
Bonfanti, Andrea ;
Vato, Alessandro .
SCIENTIFIC REPORTS, 2014, 4
[2]   A Battery-Powered Activity-Dependent Intracortical Microstimulation IC for Brain-Machine-Brain Interface [J].
Azin, Meysam ;
Guggenmos, David J. ;
Barbay, Scott ;
Nudo, Randolph J. ;
Mohseni, Pedram .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2011, 46 (04) :731-745
[3]   What limits the performance of current invasive brain machine interfaces? [J].
Baranauskas, Gytis .
FRONTIERS IN SYSTEMS NEUROSCIENCE, 2014, 8
[4]   An Analogue Front-End Model for Developing Neural Spike Sorting Systems [J].
Barsakcioglu, Deren Y. ;
Liu, Yan ;
Bhunjun, Pooja ;
Navajas, Joaquin ;
Eftekhar, Amir ;
Jackson, Andrew ;
Quiroga, Rodrigo Quian ;
Constandinou, Timothy G. .
IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, 2014, 8 (02) :216-227
[5]   Selective Attention in Multi-Chip Address-Event Systems [J].
Bartolozzi, Chiara ;
Indiveri, Giacomo .
SENSORS, 2009, 9 (07) :5076-5098
[6]   COMPUTATIONS UNDERLYING THE EXECUTION OF MOVEMENT - A BIOLOGICAL PERSPECTIVE [J].
BIZZI, E ;
MUSSAIVALDI, FA ;
GISZTER, S .
SCIENCE, 1991, 253 (5017) :287-291
[7]   A burst-mode word-serial address-event link-I transmitter design [J].
Boahen, KA .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2004, 51 (07) :1269-1280
[8]   Point-to-point connectivity between neuromorphic chips using address events [J].
Boahen, KA .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2000, 47 (05) :416-434
[9]  
Boi F, 2015, IEEE ENG MED BIO, P51, DOI 10.1109/EMBC.2015.7318298
[10]  
Boi F, 2015, I IEEE EMBS C NEUR E, P198, DOI 10.1109/NER.2015.7146594