Learning function from structure in neuromorphic networks

被引:73
作者
Suarez, Laura E. [1 ,2 ]
Richards, Blake A. [1 ,2 ,3 ,4 ]
Lajoie, Guillaume [2 ,3 ,5 ]
Misic, Bratislav [1 ]
机构
[1] McGill Univ, Montreal Neurol Inst, Montreal, PQ, Canada
[2] Quebec Artificial Intelligence Inst, Mila, Montreal, PQ, Canada
[3] CIFAR, Canada AI Chair Program, Toronto, ON, Canada
[4] McGill Univ, Sch Comp Sci, Montreal, PQ, Canada
[5] Univ Montreal, Dept Math & Stat, Montreal, PQ, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
ECHO STATE NETWORKS; LARGE-SCALE BRAIN; HUMAN CEREBRAL-CORTEX; SMALL-WORLD; HUMAN CONNECTOME; ORGANIZATION; ARCHITECTURE; DYNAMICS; CONNECTIVITY; INFORMATION;
D O I
10.1038/s42256-021-00376-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The connection patterns of neural circuits in the brain form a complex network. Collective signalling within the network manifests as patterned neural activity and is thought to support human cognition and adaptive behaviour. Recent technological advances permit macroscale reconstructions of biological brain networks. These maps, termed connectomes, display multiple non-random architectural features, including heavy-tailed degree distributions, segregated communities and a densely interconnected core. Yet, how computation and functional specialization emerge from network architecture remains unknown. Here we reconstruct human brain connectomes using in vivo diffusion-weighted imaging and use reservoir computing to implement connectomes as artificial neural networks. We then train these neuromorphic networks to learn a memory-encoding task. We show that biologically realistic neural architectures perform best when they display critical dynamics. We find that performance is driven by network topology and that the modular organization of intrinsic networks is computationally relevant. We observe a prominent interaction between network structure and dynamics throughout, such that the same underlying architecture can support a wide range of memory capacity values as well as different functions (encoding or decoding), depending on the dynamical regime the network is in. This work opens new opportunities to discover how the network organization of the brain optimizes cognitive capacity. The relationship between brain organization, connectivity and computation is not well understood. The authors construct neuromorphic artificial neural networks endowed with biological connection patterns derived from diffusion-weighted imaging. The neuromorphic networks are trained to perform a memory task, revealing an interaction between network structure and dynamics.
引用
收藏
页码:771 / 786
页数:16
相关论文
共 181 条
[101]   Individual structural features constrain the mouse functional connectome [J].
Melozzi, Francesca ;
Bergmann, Eyal ;
Harris, Julie A. ;
Kahn, Itamar ;
Jirsa, Viktor ;
Bernard, Christophe .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2019, 116 (52) :26961-26969
[102]   Relating Structure and Function in the Human Brain: Relative Contributions of Anatomy, Stationary Dynamics, and Non-stationarities [J].
Messe, Arnaud ;
Rudrauf, David ;
Benali, Habib ;
Marrelec, Guillaume .
PLOS COMPUTATIONAL BIOLOGY, 2014, 10 (03)
[103]  
MESULAM M, 1994, REV NEUROL-FRANCE, V150, P564
[104]   From sensation to cognition [J].
Mesulam, MM .
BRAIN, 1998, 121 :1013-1052
[105]   From regions to connections and networks: new bridges between brain and behavior [J].
Misic, Bratislav ;
Sporns, Olaf .
CURRENT OPINION IN NEUROBIOLOGY, 2016, 40 :1-7
[106]   Network-Level Structure-Function Relationships in Human Neocortex [J].
Misic, Bratislav ;
Betzel, Richard F. ;
de Reus, Marcel A. ;
van den Heuvel, Martijn P. ;
Berman, Marc G. ;
McIntosh, Anthony R. ;
Sporns, Olaf .
CEREBRAL CORTEX, 2016, 26 (07) :3285-3296
[107]   Cooperative and Competitive Spreading Dynamics on the Human Connectome [J].
Misic, Bratislav ;
Betzel, Richard F. ;
Nematzadeh, Azadeh ;
Goni, Joaquin ;
Griffa, Alessandra ;
Hagmann, Patric ;
Flammini, Alessandro ;
Ahn, Yong-Yeol ;
Sporns, Olaf .
NEURON, 2015, 86 (06) :1518-1529
[108]   Synaptic plasticity, memory and the hippocampus: a neural network approach to causality [J].
Neves, Guilherme ;
Cooke, Sam F. ;
Bliss, Tim V. P. .
NATURE REVIEWS NEUROSCIENCE, 2008, 9 (01) :65-75
[109]  
Oliphant T. E., 2006, A GUIDE TO NUMPY, V1
[110]   Intensity and coherence of motifs in weighted complex networks -: art. no. 065103 [J].
Onnela, JP ;
Saramäki, J ;
Kertész, J ;
Kaski, K .
PHYSICAL REVIEW E, 2005, 71 (06)