Computation noise promotes zero-shot adaptation to uncertainty during decision-making in artificial neural networks

被引:0
作者
Findling, Charles [1 ,2 ]
Wyart, Valentin [1 ,3 ,4 ]
机构
[1] Inst Natl Sante & Rech Med Inserm, Lab Neurosci Cognit & Computat, Paris, France
[2] Univ Geneva, Dept Neurosci Fondamentales, Geneva, Switzerland
[3] Univ PSL, Ecole Normale Super, Dept Etud Cognit, Paris, France
[4] Conseil Departemental Yvelines & Hauts de Seine, Inst Psychotraumatisme Enfant & Adolescent, Versailles, France
来源
SCIENCE ADVANCES | 2024年 / 10卷 / 44期
基金
欧洲研究理事会;
关键词
PREDICTION ERRORS; VARIABILITY; BEHAVIOR; CORTEX; MODEL;
D O I
10.1126/sciadv.adl3931
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Random noise in information processing systems is widely seen as detrimental to function. But despite the large trial-to-trial variability of neural activity, humans show a remarkable adaptability to conditions with uncertainty during goal-directed behavior. The origin of this cognitive ability, constitutive of general intelligence, remains elusive. Here, we show that moderate levels of computation noise in artificial neural networks promote zero-shot generalization for decision-making under uncertainty. Unlike networks featuring noise-free computations, but like human participants tested on similar decision problems (ranging from probabilistic reasoning to reversal learning), noisy networks exhibit behavioral hallmarks of optimal inference in uncertain conditions entirely unseen during training. Computation noise enables this cognitive ability jointly through "structural" regularization of network weights during training and "functional" regularization by shaping the stochastic dynamics of network activity after training. Together, these findings indicate that human cognition may ride on neural variability to support adaptive decisions under uncertainty without extensive experience or engineered sophistication.
引用
收藏
页数:14
相关论文
共 57 条
  • [1] [Anonymous], 1961, Sensory communication
  • [2] Neural correlations, population coding and computation
    Averbeck, BB
    Latham, PE
    Pouget, A
    [J]. NATURE REVIEWS NEUROSCIENCE, 2006, 7 (05) : 358 - 366
  • [3] Learning the value of information in an uncertain world
    Behrens, Timothy E. J.
    Woolrich, Mark W.
    Walton, Mark E.
    Rushworth, Matthew F. S.
    [J]. NATURE NEUROSCIENCE, 2007, 10 (09) : 1214 - 1221
  • [4] Bellemare MG, 2016, ADV NEUR IN, V29
  • [5] Hierarchically organized behavior and its neural foundations: A reinforcement learning perspective
    Botvinick, Matthew M.
    Niv, Yael
    Barto, Andrew C.
    [J]. COGNITION, 2009, 113 (03) : 262 - 280
  • [6] Chollet F, 2019, Arxiv, DOI [arXiv:1911.01547, 10.48550/arxiv.1911.01547, DOI 10.48550/ARXIV.1911.01547]
  • [7] Dapello J., 2020, Advances in Neural Information Processing Systems, V33, P13073
  • [8] Dezfouli A, 2019, ADV NEUR IN, V32
  • [9] Computational Precision of Mental Inference as Critical Source of Human Choice Suboptimality
    Drugowitsch, Jan
    Wyart, Valentin
    Devauchelle, Anne-Dominique
    Koechlin, Etienne
    [J]. NEURON, 2016, 92 (06) : 1398 - 1411
  • [10] Cortical-like dynamics in recurrent circuits optimized for sampling-based probabilistic inference
    Echeveste, Rodrigo
    Aitchison, Laurence
    Hennequin, Guillaume
    Lengyel, Mate
    [J]. NATURE NEUROSCIENCE, 2020, 23 (09) : 1138 - +