Online evaluation of novel choices by simultaneous representation of multiple memories

被引:169
作者
Barron, Helen C. [1 ]
Dolan, Raymond J. [1 ]
Behrens, Timothy E. J. [1 ,2 ]
机构
[1] UCL, Inst Neurol, Wellcome Trust Ctr Neuroimaging, London, England
[2] Univ Oxford, Oxford Ctr Funct Magnet Resonance Imaging Brain, Oxford, England
基金
英国医学研究理事会; 英国惠康基金;
关键词
ORBITOFRONTAL CORTEX; EPISODIC MEMORY; DECISION-MAKING; MECHANISMS; HIPPOCAMPAL; PREDICTION; REPETITION; SUPPORTS; REMEMBER; FUTURE;
D O I
10.1038/nn.3515
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Prior experience is critical for decision-making. It enables explicit representation of potential outcomes and provides training to valuation mechanisms. However, we can also make choices in the absence of prior experience by merely imagining the consequences of a new experience. Using functional magnetic resonance imaging repetition suppression in humans, we examined how neuronal representations of novel rewards can be constructed and evaluated. A likely novel experience was constructed by invoking multiple independent memories in hippocampus and medial prefrontal cortex. This construction persisted for only a short time period, during which new associations were observed between the memories for component items. Together, these findings suggest that, in the absence of direct experience, coactivation of multiple relevant memories can provide a training signal to the valuation system that allows the consequences of new experiences to be imagined and acted on.
引用
收藏
页码:1492 / +
页数:9
相关论文
共 50 条
[1]   Remembering the past and imagining the future: Common and distinct neural substrates during event construction and elaboration [J].
Addis, Donna Rose ;
Wong, Alana T. ;
Schacter, Daniel L. .
NEUROPSYCHOLOGIA, 2007, 45 (07) :1363-1377
[2]  
[Anonymous], 1990, MACHINE LEARNING P 1, DOI DOI 10.1016/B978-1-55860-141-3.50030-4
[3]   Goal-directed instrumental action: contingency and incentive learning and their cortical substrates [J].
Balleine, BW ;
Dickinson, A .
NEUROPHARMACOLOGY, 1998, 37 (4-5) :407-419
[4]   MEASURING UTILITY BY A SINGLE-RESPONSE SEQUENTIAL METHOD [J].
BECKER, GM ;
DEGROOT, MH ;
MARSCHAK, J .
BEHAVIORAL SCIENCE, 1964, 9 (03) :226-232
[5]   Associative learning of social value [J].
Behrens, Timothy E. J. ;
Hunt, Laurence T. ;
Woolrich, Mark W. ;
Rushworth, Matthew F. S. .
NATURE, 2008, 456 (7219) :245-U45
[6]   How Green Is the Grass on the Other Side? Frontopolar Cortex and the Evidence in Favor of Alternative Courses of Action [J].
Boorman, Erie D. ;
Behrens, Timothy E. J. ;
Woolrich, Mark W. ;
Rushworth, Matthew F. S. .
NEURON, 2009, 62 (05) :733-743
[7]   The Role of the Hippocampus in Prediction and Imagination [J].
Buckner, Randy L. .
ANNUAL REVIEW OF PSYCHOLOGY, 2010, 61 :27-48
[8]   Item, context and relational episodic encoding in humans [J].
Davachi, Lila .
CURRENT OPINION IN NEUROBIOLOGY, 2006, 16 (06) :693-700
[9]   Model-Based Influences on Humans' Choices and Striatal Prediction Errors [J].
Daw, Nathaniel D. ;
Gershman, Samuel J. ;
Seymour, Ben ;
Dayan, Peter ;
Dolan, Raymond J. .
NEURON, 2011, 69 (06) :1204-1215
[10]   Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control [J].
Daw, ND ;
Niv, Y ;
Dayan, P .
NATURE NEUROSCIENCE, 2005, 8 (12) :1704-1711