Neural Mechanisms of Human Decision-Making

被引:0
作者
Seth Herd
Kai Krueger
Ananta Nair
Jessica Mollick
Randall O’Reilly
机构
[1] eCortex,
[2] Inc.,undefined
[3] University of Colorado,undefined
[4] Yale University,undefined
[5] University of California,undefined
[6] Davis,undefined
来源
Cognitive, Affective, & Behavioral Neuroscience | 2021年 / 21卷
关键词
Neural network; Decision-making; Basal ganglia; Model-based; Controlled processing;
D O I
暂无
中图分类号
学科分类号
摘要
We present a theory and neural network model of the neural mechanisms underlying human decision-making. We propose a detailed model of the interaction between brain regions, under a proposer-predictor-actor-critic​ ​framework. This theory is based on detailed animal data and theories of action-selection. Those theories are adapted to serial operation to bridge levels of analysis and explain human decision-making. Task-relevant areas of cortex propose a candidate plan using fast, model-free, parallel neural computations. Other areas of cortex and medial temporal lobe can then predict​ likely outcomes of that plan in this situation. This optional prediction- (or model-) based computation can produce better accuracy and generalization, at the expense of speed. Next, linked regions of basal ganglia act​ to accept or reject the proposed plan based on its reward history in similar contexts. If that plan is rejected, the process repeats to consider a new option. The reward-prediction system acts as a critic​ to determine the value of the outcome relative to expectations and produce dopamine as a training signal for cortex and basal ganglia. By operating sequentially and hierarchically, the same mechanisms previously proposed for animal action-selection could explain the most complex human plans and decisions. We discuss explanations of model-based decisions, habitization, and risky behavior based on the computational model.
引用
收藏
页码:35 / 57
页数:22
相关论文
共 236 条
  • [51] Deco G(2017)Motivated numeracy and enlightened self-government Behavioural Public Policy 1 661-876
  • [52] Rolls ET(2012)Integrating cortico-limbic-basal ganglia architectures for learning model-based and model-free navigation strategies Frontiers in Behavioral Neuroscience 6 687-1156
  • [53] Deco G(2007)Anterior prefrontal function and the limits of human decision-making Science 318 1344-238
  • [54] Rolls ET(2016)When does model-based control pay off? PLOS Comput Biol 12 167-124
  • [55] Ding L(2013)An opportunity cost model of subjective effort and task performance Behavioral and Brain Sciences 36 381-5539
  • [56] Gold JI(2014)Neural computations underlying arbitration between model-based and model-free learning Neuron 81 12294-305
  • [57] Doll BB(2015)The formation of hierarchical decisions in the visual cortex Neuron 87 117-178
  • [58] Simon DA(2001)An integrative theory of prefrontal cortex function Annual Review of Neuroscience 24 838-2232
  • [59] Daw ND(1996)The basal ganglia: focused selection and inhibition of competing motor programs Progress in Neurobiology 50 283-279
  • [60] Donoso M(2008)A role for dopamine in temporal decision making and reward maximization in parkinsonism Journal of Neuroscience 28 380-76