Learning function from structure in neuromorphic networks

被引:73
作者
Suarez, Laura E. [1 ,2 ]
Richards, Blake A. [1 ,2 ,3 ,4 ]
Lajoie, Guillaume [2 ,3 ,5 ]
Misic, Bratislav [1 ]
机构
[1] McGill Univ, Montreal Neurol Inst, Montreal, PQ, Canada
[2] Quebec Artificial Intelligence Inst, Mila, Montreal, PQ, Canada
[3] CIFAR, Canada AI Chair Program, Toronto, ON, Canada
[4] McGill Univ, Sch Comp Sci, Montreal, PQ, Canada
[5] Univ Montreal, Dept Math & Stat, Montreal, PQ, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
ECHO STATE NETWORKS; LARGE-SCALE BRAIN; HUMAN CEREBRAL-CORTEX; SMALL-WORLD; HUMAN CONNECTOME; ORGANIZATION; ARCHITECTURE; DYNAMICS; CONNECTIVITY; INFORMATION;
D O I
10.1038/s42256-021-00376-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The connection patterns of neural circuits in the brain form a complex network. Collective signalling within the network manifests as patterned neural activity and is thought to support human cognition and adaptive behaviour. Recent technological advances permit macroscale reconstructions of biological brain networks. These maps, termed connectomes, display multiple non-random architectural features, including heavy-tailed degree distributions, segregated communities and a densely interconnected core. Yet, how computation and functional specialization emerge from network architecture remains unknown. Here we reconstruct human brain connectomes using in vivo diffusion-weighted imaging and use reservoir computing to implement connectomes as artificial neural networks. We then train these neuromorphic networks to learn a memory-encoding task. We show that biologically realistic neural architectures perform best when they display critical dynamics. We find that performance is driven by network topology and that the modular organization of intrinsic networks is computationally relevant. We observe a prominent interaction between network structure and dynamics throughout, such that the same underlying architecture can support a wide range of memory capacity values as well as different functions (encoding or decoding), depending on the dynamical regime the network is in. This work opens new opportunities to discover how the network organization of the brain optimizes cognitive capacity. The relationship between brain organization, connectivity and computation is not well understood. The authors construct neuromorphic artificial neural networks endowed with biological connection patterns derived from diffusion-weighted imaging. The neuromorphic networks are trained to perform a memory task, revealing an interaction between network structure and dynamics.
引用
收藏
页码:771 / 786
页数:16
相关论文
共 181 条
[91]   Reservoir computing approaches to recurrent neural network training [J].
Lukosevicius, Mantas ;
Jaeger, Herbert .
COMPUTER SCIENCE REVIEW, 2009, 3 (03) :127-149
[92]   Real-time computing without stable states:: A new framework for neural computation based on perturbations [J].
Maass, W ;
Natschläger, T ;
Markram, H .
NEURAL COMPUTATION, 2002, 14 (11) :2531-2560
[93]  
Maass W, 2004, J COMPUT SYST SCI, V69, P593, DOI [10.1016/j.jcss.2004.04.001, 10.1016/j jcss.2004.04.001]
[94]   The challenge of mapping the human connectome based on diffusion tractography [J].
Maier-Hein, Klaus H. ;
Neher, Peter F. ;
Houde, Jean-Christophe ;
Cote, Marc-Alexandre ;
Garyfallidis, Eleftherios ;
Zhong, Jidan ;
Chamberland, Maxime ;
Yeh, Fang-Cheng ;
Lin, Ying-Chia ;
Ji, Qing ;
Reddick, Wilburn E. ;
Glass, John O. ;
Chen, David Qixiang ;
Feng, Yuanjing ;
Gao, Chengfeng ;
Wu, Ye ;
Ma, Jieyan ;
Renjie, H. ;
Li, Qiang ;
Westin, Carl-Fredrik ;
Deslauriers-Gauthier, Samuel ;
Ocegueda Gonzalez, J. Omar ;
Paquette, Michael ;
St-Jean, Samuel ;
Girard, Gabriel ;
Rheault, Francois ;
Sidhu, Jasmeen ;
Tax, Chantal M. W. ;
Guo, Fenghua ;
Mesri, Hamed Y. ;
David, Szabolcs ;
Froeling, Martijn ;
Heemskerk, Anneriet M. ;
Leemans, Alexander ;
Bore, Arnaud ;
Pinsard, Basile ;
Bedetti, Christophe ;
Desrosiers, Matthieu ;
Brambati, Simona ;
Doyon, Julien ;
Sarica, Alessia ;
Vasta, Roberta ;
Cerasa, Antonio ;
Quattrone, Aldo ;
Yeatman, Jason ;
Khan, Ali R. ;
Hodges, Wes ;
Alexander, Simon ;
Romascano, David ;
Barakovic, Muhamed .
NATURE COMMUNICATIONS, 2017, 8
[95]   Situating the default-mode network along a principal gradient of macroscale cortical organization [J].
Margulies, Daniel S. ;
Ghosh, Satrajit S. ;
Goulas, Alexandros ;
Falkiewicz, Marcel ;
Huntenburg, Julia M. ;
Langs, Georg ;
Bezgin, Gleb ;
Eickhoff, Simon B. ;
Castellanos, F. Xavier ;
Petrides, Michael ;
Jefferies, Elizabeth ;
Smallwood, Jonathan .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2016, 113 (44) :12574-12579
[96]   Comparing spatial null models for brain maps [J].
Markello, Ross D. ;
Misic, Bratislav .
NEUROIMAGE, 2021, 236
[97]   Specificity and stability in topology of protein networks [J].
Maslov, S ;
Sneppen, K .
SCIENCE, 2002, 296 (5569) :910-913
[98]   Linking Connectivity, Dynamics, and Computations in Low-Rank Recurrent Neural Networks [J].
Mastrogiuseppe, Francesca ;
Ostojic, Srdjan .
NEURON, 2018, 99 (03) :609-+
[99]  
McKinney W., 2010, PROC 9 PYTHON SCI C, V445, P51, DOI DOI 10.25080/MAJORA-92BF1922-00A
[100]   Functional alignment with anatomical networks is associated with cognitive flexibility [J].
Medaglia, John D. ;
Huang, Weiyu ;
Karuza, Elisabeth A. ;
Kelkar, Apoorva ;
Thompson-Schill, Sharon L. ;
Ribeiro, Alejandro ;
Bassett, Danielle S. .
NATURE HUMAN BEHAVIOUR, 2018, 2 (02) :156-164