Neural Mechanisms of Human Decision-Making

被引:0
作者
Seth Herd
Kai Krueger
Ananta Nair
Jessica Mollick
Randall O’Reilly
机构
[1] eCortex,
[2] Inc.,undefined
[3] University of Colorado,undefined
[4] Yale University,undefined
[5] University of California,undefined
[6] Davis,undefined
来源
Cognitive, Affective, & Behavioral Neuroscience | 2021年 / 21卷
关键词
Neural network; Decision-making; Basal ganglia; Model-based; Controlled processing;
D O I
暂无
中图分类号
学科分类号
摘要
We present a theory and neural network model of the neural mechanisms underlying human decision-making. We propose a detailed model of the interaction between brain regions, under a proposer-predictor-actor-critic​ ​framework. This theory is based on detailed animal data and theories of action-selection. Those theories are adapted to serial operation to bridge levels of analysis and explain human decision-making. Task-relevant areas of cortex propose a candidate plan using fast, model-free, parallel neural computations. Other areas of cortex and medial temporal lobe can then predict​ likely outcomes of that plan in this situation. This optional prediction- (or model-) based computation can produce better accuracy and generalization, at the expense of speed. Next, linked regions of basal ganglia act​ to accept or reject the proposed plan based on its reward history in similar contexts. If that plan is rejected, the process repeats to consider a new option. The reward-prediction system acts as a critic​ to determine the value of the outcome relative to expectations and produce dopamine as a training signal for cortex and basal ganglia. By operating sequentially and hierarchically, the same mechanisms previously proposed for animal action-selection could explain the most complex human plans and decisions. We discuss explanations of model-based decisions, habitization, and risky behavior based on the computational model.
引用
收藏
页码:35 / 57
页数:22
相关论文
共 236 条
  • [1] Ackley DH(1985)A learning algorithm for Boltzmann machines Cognitive Science 9 147-169
  • [2] Hinton GE(1986)Parallel organization of functionally segregated circuits linking basal ganglia and cortex Annual Review of Neuroscience 9 357-381
  • [3] Sejnowski TJ(2010)Cortical and basal ganglia contributions to habit learning and automaticity Trends in Cognitive Sciences 14 208-215
  • [4] Alexander GE(2007)The role of the dorsal striatum in reward and decision-making Journal of Neuroscience 27 8161-8165
  • [5] DeLong MR(1998)Goal-directed instrumental action: contingency and incentive learning and their cortical substrates Neuropharmacology 37 407-419
  • [6] Strick PL(2008)Grounded cognition Annual Review of Psychology 59 617-45
  • [7] Ashby FG(2015)Impulsive people have a compulsion for immediate gratification—certain or uncertain Frontiers in Psychology 6 515-477
  • [8] Turner BO(2007)The basal ganglia and cortex implement optimal decision making between alternative actions Neural Computation 19 442-510
  • [9] Horvitz JC(2014)Model-based hierarchical reinforcement learning and human action control Phil. Trans. R. Soc. B 369 471-1151
  • [10] Balleine BW(2004)How laminar frontal cortex and basal ganglia circuits interact to control planned and reactive saccades Neural Networks 17 432-361