Information dynamics in neuromorphic nanowire networks

被引:33
作者
Zhu, Ruomin [1 ]
Hochstetter, Joel [1 ]
Loeffler, Alon [1 ]
Diaz-Alvarez, Adrian [2 ]
Nakayama, Tomonobu [1 ,2 ,3 ]
Lizier, Joseph T. [4 ]
Kuncic, Zdenka [1 ,2 ,4 ,5 ]
机构
[1] Univ Sydney, Sch Phys, Sydney, NSW 2006, Australia
[2] Natl Inst Mat Sci NIMS, Int Ctr Mat Nanoarchitecton WPI MANA, 1-1 Namiki, Tsukuba, Ibaraki 3050044, Japan
[3] Univ Tsukuba, Grad Sch Pure & Appl Sci, Tsukuba, Ibaraki, Japan
[4] Univ Sydney, Fac Engn, Ctr Complex Syst, Sydney, NSW 2006, Australia
[5] Univ Sydney, Sydney Nano Inst, Sydney, NSW 2006, Australia
关键词
MODULARITY; CENTRALITY; BRAIN; EDGE; CONNECTIVITY; ARCHITECTURE; PERFORMANCE; PLASTICITY; EVOLUTION; CIRCUIT;
D O I
10.1038/s41598-021-92170-7
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Neuromorphic systems comprised of self-assembled nanowires exhibit a range of neural-like dynamics arising from the interplay of their synapse-like electrical junctions and their complex network topology. Additionally, various information processing tasks have been demonstrated with neuromorphic nanowire networks. Here, we investigate the dynamics of how these unique systems process information through information-theoretic metrics. In particular, Transfer Entropy (TE) and Active Information Storage (AIS) are employed to investigate dynamical information flow and short-term memory in nanowire networks. In addition to finding that the topologically central parts of networks contribute the most to the information flow, our results also reveal TE and AIS are maximized when the networks transitions from a quiescent to an active state. The performance of neuromorphic networks in memory and learning tasks is demonstrated to be dependent on their internal dynamical states as well as topological structure. Optimal performance is found when these networks are pre-initialised to the transition state where TE and AIS are maximal. Furthermore, an optimal range of information processing resources (i.e. connectivity density) is identified for performance. Overall, our results demonstrate information dynamics is a valuable tool to study and benchmark neuromorphic systems.
引用
收藏
页数:15
相关论文
共 102 条
[1]  
[Anonymous], 2008, ALIFE CITESEER
[2]   Deep Machine Learning-A New Frontier in Artificial Intelligence Research [J].
Arel, Itamar ;
Rose, Derek C. ;
Karnowski, Thomas P. .
IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2010, 5 (04) :13-18
[3]   Neuromorphic Atomic Switch Networks [J].
Avizienis, Audrius V. ;
Sillin, Henry O. ;
Martin-Olmos, Cristina ;
Shieh, Hsien Hang ;
Aono, Masakazu ;
Stieg, Adam Z. ;
Gimzewski, James K. .
PLOS ONE, 2012, 7 (08)
[4]   Information Flow in a Kinetic Ising Model Peaks in the Disordered Phase [J].
Barnett, Lionel ;
Lizier, Joseph T. ;
Harre, Michael ;
Seth, Anil K. ;
Bossomaier, Terry .
PHYSICAL REVIEW LETTERS, 2013, 111 (17)
[5]   The architecture of complex weighted networks [J].
Barrat, A ;
Barthélemy, M ;
Pastor-Satorras, R ;
Vespignani, A .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2004, 101 (11) :3747-3752
[6]   Dynamic reconfiguration of human brain networks during learning [J].
Bassett, Danielle S. ;
Wymbs, Nicholas F. ;
Porter, Mason A. ;
Mucha, Peter J. ;
Carlson, Jean M. ;
Grafton, Scott T. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2011, 108 (18) :7641-7646
[7]   Understanding complexity in the human brain [J].
Bassett, Danielle S. ;
Gazzaniga, Michael S. .
TRENDS IN COGNITIVE SCIENCES, 2011, 15 (05) :200-209
[8]   Programmability of nanowire networks [J].
Bellew, A. T. ;
Bell, A. P. ;
McCarthy, E. K. ;
Fairfield, J. A. ;
Boland, J. J. .
NANOSCALE, 2014, 6 (16) :9632-9639
[9]   Real-time computation at the edge of chaos in recurrent neural networks [J].
Bertschinger, N ;
Natschläger, T .
NEURAL COMPUTATION, 2004, 16 (07) :1413-1436
[10]   Fast unfolding of communities in large networks [J].
Blondel, Vincent D. ;
Guillaume, Jean-Loup ;
Lambiotte, Renaud ;
Lefebvre, Etienne .
JOURNAL OF STATISTICAL MECHANICS-THEORY AND EXPERIMENT, 2008,