Modularity and multitasking in neuro-memristive reservoir networks

被引:16
作者
Loeffler, Alon [1 ]
Zhu, Ruomin [1 ]
Hochstetter, Joel [1 ]
Diaz-Alvarez, Adrian [3 ]
Nakayama, Tomonobu [1 ,3 ,4 ]
Shine, James M. [1 ,5 ,6 ]
Kuncic, Zdenka [1 ,2 ,3 ]
机构
[1] Univ Sydney, Sch Phys, Sydney, Australia
[2] Univ Sydney, Nano Inst, Sydney, Australia
[3] Natl Inst Mat Sci NIMS, Int Ctr Mat Nanoarchitecton WPI MANA, Tsukuba, Japan
[4] Univ Tsukuba, Grad Sch Pure & Appl Sci, Tsukuba, Japan
[5] Univ Sydney, Sch Med Sci, Sydney, Australia
[6] Univ Sydney, Brain & Mind Ctr, Sydney, Australia
来源
NEUROMORPHIC COMPUTING AND ENGINEERING | 2021年 / 1卷 / 01期
关键词
modularity; multitasking; neuromemristive; nanowire networks; reservoir computing; neuromorphic networks; MEMORY CAPACITY; PERFORMANCE; COMPUTERS;
D O I
10.1088/2634-4386/ac156f
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The human brain seemingly effortlessly performs multiple concurrent and elaborate tasks in response to complex, dynamic sensory input from our environment. This capability has been attributed to the highly modular structure of the brain, enabling specific task assignment among different regions and limiting interference between them. Here, we compare the structure and functional capabilities of different bio-physically inspired and biological networks. We then focus on the influence of topological properties on the functional performance of highly modular, bio-physically inspired neuro-memristive nanowire networks (NWNs). We perform two benchmark reservoir computing tasks (memory capacity and nonlinear transformation) on simulated networks and show that while random networks outperform NWNs on independent tasks, NWNs with highly segregated modules achieve the best performance on simultaneous tasks. Conversely, networks that share too many resources, such as networks with random structure, perform poorly in multitasking. Overall, our results show that structural properties such as modularity play a critical role in trafficking information flow, preventing information from spreading indiscriminately throughout NWNs.
引用
收藏
页数:15
相关论文
共 71 条
[1]  
Achacoso T.B., 1991, AY's Neuroanatomy of C. Elegans for Computation
[2]   True North: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic Chip [J].
Akopyan, Filipp ;
Sawada, Jun ;
Cassidy, Andrew ;
Alvarez-Icaza, Rodrigo ;
Arthur, John ;
Merolla, Paul ;
Imam, Nabil ;
Nakamura, Yutaka ;
Datta, Pallab ;
Nam, Gi-Joon ;
Taba, Brian ;
Beakes, Michael ;
Brezzo, Bernard ;
Kuang, Jente B. ;
Manohar, Rajit ;
Risk, William P. ;
Jackson, Bryan ;
Modha, Dharmendra S. .
IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2015, 34 (10) :1537-1557
[3]  
Angeline P., 1994, Advances in Genetic Programming, V1, P75
[4]  
Barancok Peter, 2014, Artificial Neural Networks and Machine Learning - ICANN 2014. 24th International Conference on Artificial Neural Networks. Proceedings: LNCS 8681, P41, DOI 10.1007/978-3-319-11179-7_6
[5]   Understanding complexity in the human brain [J].
Bassett, Danielle S. ;
Gazzaniga, Michael S. .
TRENDS IN COGNITIVE SCIENCES, 2011, 15 (05) :200-209
[6]   Representation Learning: A Review and New Perspectives [J].
Bengio, Yoshua ;
Courville, Aaron ;
Vincent, Pascal .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (08) :1798-1828
[7]   Fast unfolding of communities in large networks [J].
Blondel, Vincent D. ;
Guillaume, Jean-Loup ;
Lambiotte, Renaud ;
Lefebvre, Etienne .
JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT, 2008,
[8]   Complex brain networks: graph theoretical analysis of structural and functional systems [J].
Bullmore, Edward T. ;
Sporns, Olaf .
NATURE REVIEWS NEUROSCIENCE, 2009, 10 (03) :186-198
[9]   Multitask learning [J].
Caruana, R .
MACHINE LEARNING, 1997, 28 (01) :41-75
[10]  
Changpinyo S, 2017, Arxiv, DOI arXiv:1702.06257