Brain-inspired wiring economics for artificial neural networks

被引:0
作者
Zhang, Xin-Jie [1 ,2 ]
Moore, Jack Murdoch [1 ,2 ]
Gao, Ting-Ting [1 ,2 ]
Zhang, Xiaozhu [1 ,2 ,3 ,4 ]
Yan, Gang [1 ,2 ,5 ]
机构
[1] Tongji Univ, Sch Phys Sci & Engn, Shanghai 200092, Peoples R China
[2] Tongji Univ, MOE Frontiers Sci Ctr Intelligent Autonomous Syst, Natl Key Lab Autonomous Intelligent Unmanned Syst, Shanghai 200092, Peoples R China
[3] Tech Univ Dresden, Chair Network Dynam, Ctr Adv Elect Dresden cfaed, D-01062 Dresden, Germany
[4] Tech Univ Dresden, Inst Theoret Phys, D-01062 Dresden, Germany
[5] Chinese Acad Sci, CAS Ctr Excellence Brain Sci & Intelligence Techno, Shanghai 200031, Peoples R China
来源
PNAS NEXUS | 2025年 / 4卷 / 01期
基金
中国国家自然科学基金;
关键词
wiring cost; brain-like computing; interpretable AI; bio-inspired AI; sparse neural networks; CONNECTIVITY; OPTIMIZATION; MODULARITY; REGRESSION;
D O I
10.1093/pnasnexus/pgae580
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Wiring patterns of brain networks embody a trade-off between information transmission, geometric constraints, and metabolic cost, all of which must be balanced to meet functional needs. Geometry and wiring economy are crucial in the development of brains, but their impact on artificial neural networks (ANNs) remains little understood. Here, we adopt a wiring cost-controlled training framework that simultaneously optimizes wiring efficiency and task performance during structural evolution of sparse ANNs whose nodes are located at arbitrary but fixed positions. We show that wiring cost control improves performance across a wide range of tasks, ANN architectures and training methods, and can promote task-specific structural modules. An optimal wiring cost range provides both enhanced predictive performance and high values of topological properties, such as modularity and clustering, which are observed in real brain networks and known to improve robustness, interpretability, and performance of ANNs. In addition, ANNs trained using wiring cost can emulate the connection distance distribution observed in the brains of real organisms (such as Ciona intestinalis and Caenorhabditis elegans), especially when achieving high task performance, offering insights into biological organizing principles. Our results shed light on the relationship between topology and task specialization of ANNs trained within biophysical constraints, and their geometric resemblance to real neuronal-level brain maps.
引用
收藏
页数:12
相关论文
共 61 条
[1]   Spatially embedded recurrent neural networks reveal widespread links between structural and functional neuroscience findings [J].
Achterberg, Jascha ;
Akarca, Danyal ;
Strouse, D. J. ;
Duncan, John ;
Astle, Duncan E. .
NATURE MACHINE INTELLIGENCE, 2023, 5 (12) :1369-1381
[2]   Introducing Kolmogorov-Smirnov Tests under Uncertainty: An Application to Radioactive Data [J].
Aslam, Muhammad .
ACS OMEGA, 2020, 5 (01) :914-917
[3]   Network inference from short, noisy, low time-resolution, partial measurements: Application to C. elegans neuronal calcium dynamics [J].
Banerjee, Amitava ;
Chandra, Sarthak ;
Ott, Edward .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2023, 120 (12)
[4]  
Bellec G., 2018, INT C LEARN REPR
[5]  
Bernatskiy Anton., 2015, Proceedings of the Companion Publication of the 2015 Annual Conference on Genetic and Evolutionary Computation, P1173, DOI [10.1145/2739482.2768472, DOI 10.1145/2739482.2768472]
[6]   A connectivity-constrained computational account of topographic organization in primate high-level visual cortex [J].
Blauch, Nicholas M. ;
Behrmann, Marlene ;
Plaut, David C. .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2022, 119 (03)
[7]   The economy of brain network organization [J].
Bullmore, Edward T. ;
Sporns, Olaf .
NATURE REVIEWS NEUROSCIENCE, 2012, 13 (05) :336-349
[8]  
Casper S., 2022, ICLR 2022 WORKSH STR
[9]   Wiring optimization can relate neuronal structure and function [J].
Chen, BL ;
Hall, DH ;
Chklovskii, DB .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2006, 103 (12) :4723-4728
[10]  
Chen R T Q., 2018, Advances in Neural Information Processing Systems, P31