Emergence of associative learning in a neuromorphic inference network

被引:12
作者
Gandolfi, Daniela [1 ]
Puglisi, Francesco M. [2 ,3 ]
Boiani, Giulia M. [1 ]
Pagnoni, Giuseppe [1 ,3 ]
Friston, Karl J. [4 ]
D'Angelo, Egidio [5 ,6 ]
Mapelli, Jonathan [1 ,3 ]
机构
[1] Univ Modena & Reggio Emilia, Dept Biomed Metab & Neural Sci, Modena, Italy
[2] Univ Modena & Reggio Emilia, Dept Engn Enzo Ferrari, Modena, Italy
[3] Univ Modena & Reggio Emilia, Ctr Neurosci & Neurotechnol, Modena, Italy
[4] UCL, Inst Neurol, 12 Queen Sq, London WC1N 3AR, England
[5] Univ Pavia, Dept Brain & Behav Sci, Pavia, Italy
[6] IRCCS Mondino Fdn, Brain Connect Ctr, Pavia, Italy
关键词
predictive coding; unsupervised learning; neuromorphic electronic; brain-inspired computing; FREE-ENERGY PRINCIPLE; SYNAPTIC PLASTICITY; INTERNAL-MODELS; NEURAL-NETWORK; IMPLEMENTATION; CEREBELLUM;
D O I
10.1088/1741-2552/ac6ca7
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. In the theoretical framework of predictive coding and active inference, the brain can be viewed as instantiating a rich generative model of the world that predicts incoming sensory data while continuously updating its parameters via minimization of prediction errors. While this theory has been successfully applied to cognitive processes-by modelling the activity of functional neural networks at a mesoscopic scale-the validity of the approach when modelling neurons as an ensemble of inferring agents, in a biologically plausible architecture, remained to be explored. Approach. We modelled a simplified cerebellar circuit with individual neurons acting as Bayesian agents to simulate the classical delayed eyeblink conditioning protocol. Neurons and synapses adjusted their activity to minimize their prediction error, which was used as the network cost function. This cerebellar network was then implemented in hardware by replicating digital neuronal elements via a low-power microcontroller. Main results. Persistent changes of synaptic strength-that mirrored neurophysiological observations-emerged via local (neurocentric) prediction error minimization, leading to the expression of associative learning. The same paradigm was effectively emulated in low-power hardware showing remarkably efficient performance compared to conventional neuromorphic architectures. Significance. These findings show that: (a) an ensemble of free energy minimizing neurons-organized in a biological plausible architecture-can recapitulate functional self-organization observed in nature, such as associative plasticity, and (b) a neuromorphic network of inference units can learn unsupervised tasks without embedding predefined learning rules in the circuit, thus providing a potential avenue to a novel form of brain-inspired artificial intelligence.
引用
收藏
页数:15
相关论文
共 58 条
[1]   Synaptic plasticity as Bayesian inference [J].
Aitchison, Laurence ;
Jegminat, Jannes ;
Menendez, Jorge Aurelio ;
Pfister, Jean-Pascal ;
Pouget, Alexandre ;
Latham, Peter E. .
NATURE NEUROSCIENCE, 2021, 24 (04) :565-571
[2]  
An HY, 2017, IEEE CONF NANOTECH, P555, DOI 10.1109/NANO.2017.8117459
[3]   Control of a Humanoid NAO Robot by an Adaptive Bioinspired Cerebellar Module in 3D Motion Tasks [J].
Antonietti, Alberto ;
Martina, Dario ;
Casellato, Claudia ;
D'Angelo, Egidio ;
Pedrocchi, Alessandra .
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2019, 2019
[4]   Spiking Neural Network With Distributed Plasticity Reproduces Cerebellar Learning in Eye Blink Conditioning Paradigms [J].
Antonietti, Alberto ;
Casellato, Claudia ;
Garrido, Jesus A. ;
Luque, Niceto R. ;
Naveros, Francisco ;
Ros, Eduardo ;
D'Angelo, Egidio ;
Pedrocchi, Alessandra .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2016, 63 (01) :210-219
[5]   Impact of parallel fiber to Purkinje cell long-term depression is unmasked in absence of inhibitory input [J].
Boele, Henk-Jan ;
Peter, Sasa ;
Ten Brinke, Michiel M. ;
Verdonschot, Lucas ;
IJpelaar, Anna C. H. ;
Rizopoulos, Dimitris ;
Gao, Zhenyu ;
Koekkoek, Sebastiaan K. E. ;
De Zeeuw, Chris, I .
SCIENCE ADVANCES, 2018, 4 (10)
[6]   Cellular-resolution mapping uncovers spatial adaptive filtering at the rat cerebellum input stage [J].
Casali, Stefano ;
Tognolina, Marialuisa ;
Gandolfi, Daniela ;
Mapelli, Jonathan ;
D'Angelo, Egidio .
COMMUNICATIONS BIOLOGY, 2020, 3 (01)
[7]   Seeking a unified framework for cerebellar function and dysfunction: from circuit operations to cognition [J].
D'Angelo, Egidio ;
Casali, Stefano .
FRONTIERS IN NEURAL CIRCUITS, 2013, 6
[8]   On variational message passing on factor graphs [J].
Dauwels, Justin .
2007 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS, VOLS 1-7, 2007, :2546-2550
[9]   THE HELMHOLTZ MACHINE [J].
DAYAN, P ;
HINTON, GE ;
NEAL, RM ;
ZEMEL, RS .
NEURAL COMPUTATION, 1995, 7 (05) :889-904
[10]  
Eccles JC, 1967, CEREBELLUM NEURONAL