Learning function from structure in neuromorphic networks

被引:73
作者
Suarez, Laura E. [1 ,2 ]
Richards, Blake A. [1 ,2 ,3 ,4 ]
Lajoie, Guillaume [2 ,3 ,5 ]
Misic, Bratislav [1 ]
机构
[1] McGill Univ, Montreal Neurol Inst, Montreal, PQ, Canada
[2] Quebec Artificial Intelligence Inst, Mila, Montreal, PQ, Canada
[3] CIFAR, Canada AI Chair Program, Toronto, ON, Canada
[4] McGill Univ, Sch Comp Sci, Montreal, PQ, Canada
[5] Univ Montreal, Dept Math & Stat, Montreal, PQ, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
ECHO STATE NETWORKS; LARGE-SCALE BRAIN; HUMAN CEREBRAL-CORTEX; SMALL-WORLD; HUMAN CONNECTOME; ORGANIZATION; ARCHITECTURE; DYNAMICS; CONNECTIVITY; INFORMATION;
D O I
10.1038/s42256-021-00376-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The connection patterns of neural circuits in the brain form a complex network. Collective signalling within the network manifests as patterned neural activity and is thought to support human cognition and adaptive behaviour. Recent technological advances permit macroscale reconstructions of biological brain networks. These maps, termed connectomes, display multiple non-random architectural features, including heavy-tailed degree distributions, segregated communities and a densely interconnected core. Yet, how computation and functional specialization emerge from network architecture remains unknown. Here we reconstruct human brain connectomes using in vivo diffusion-weighted imaging and use reservoir computing to implement connectomes as artificial neural networks. We then train these neuromorphic networks to learn a memory-encoding task. We show that biologically realistic neural architectures perform best when they display critical dynamics. We find that performance is driven by network topology and that the modular organization of intrinsic networks is computationally relevant. We observe a prominent interaction between network structure and dynamics throughout, such that the same underlying architecture can support a wide range of memory capacity values as well as different functions (encoding or decoding), depending on the dynamical regime the network is in. This work opens new opportunities to discover how the network organization of the brain optimizes cognitive capacity. The relationship between brain organization, connectivity and computation is not well understood. The authors construct neuromorphic artificial neural networks endowed with biological connection patterns derived from diffusion-weighted imaging. The neuromorphic networks are trained to perform a memory task, revealing an interaction between network structure and dynamics.
引用
收藏
页码:771 / 786
页数:16
相关论文
共 181 条
[1]  
Aceituno PV, 2020, ISCIENCE, V23, DOI 10.1016/j.isci.2020.101440
[2]   On testing for spatial correspondence between maps of human brain structure and function [J].
Alexander-Bloch, Aaron F. ;
Shou, Haochang ;
Liu, Siyuan ;
Satterthwaite, Theodore D. ;
Glahn, David C. ;
Shinohara, Russell T. ;
Vandekar, Simon N. ;
Raznahan, Armin .
NEUROIMAGE, 2018, 178 :540-551
[3]  
Alomar ML, 2014, INT WORKS POW TIM
[4]  
[Anonymous], SEABORN V0 7 0
[5]   On Learning Navigation Behaviors for Small Mobile Robots With Reservoir Computing Architectures [J].
Antonelo, Eric Aislan ;
Schrauwen, Benjamin .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2015, 26 (04) :763-780
[6]  
Antonik P., 2015, 24 BELG DUTCH C MACH
[7]  
Antonik Piotr., 2018, Application of FPGA to Real-Time Machine Learning: Hardware Reservoir Computers and Software Image Processing
[8]   Information processing using a single dynamical node as complex system [J].
Appeltant, L. ;
Soriano, M. C. ;
Van der Sande, G. ;
Danckaert, J. ;
Massar, S. ;
Dambre, J. ;
Schrauwen, B. ;
Mirasso, C. R. ;
Fischer, I. .
NATURE COMMUNICATIONS, 2011, 2
[9]   Network neuroscience [J].
Bassett, Danielle S. ;
Sporns, Olaf .
NATURE NEUROSCIENCE, 2017, 20 (03) :353-364
[10]   Conserved and variable architecture of human white matter connectivity [J].
Bassett, Danielle S. ;
Brown, Jesse A. ;
Deshpande, Vibhas ;
Carlson, Jean M. ;
Grafton, Scott T. .
NEUROIMAGE, 2011, 54 (02) :1262-1279