Differential replay of reward and punishment paths predicts approach and avoidance

被引:11
作者
McFadyen, Jessica [1 ,2 ]
Liu, Yunzhe [3 ,4 ]
Dolan, Raymond J. [1 ,2 ]
机构
[1] UCL, UCL Max Planck Ctr Computat Psychiat & Ageing Res, London, England
[2] UCL, Wellcome Ctr Human Neuroimaging, London, England
[3] Beijing Normal Univ, McGovern Inst Brain Res, State Key Lab Cognit Neurosci & Learning, IDG, Beijing, Peoples R China
[4] Chinese Inst Brain Res, Beijing, Peoples R China
基金
中国国家自然科学基金; 英国惠康基金;
关键词
MEDIAL PREFRONTAL CORTEX; HIPPOCAMPAL PLACE CELLS; SHARP-WAVE-RIPPLE; BEHAVIORAL SEQUENCES; CORTICAL ACTIVITY; REVERSE REPLAY; AWAKE REPLAY; MEMORY; EXPERIENCE; REACTIVATION;
D O I
10.1038/s41593-023-01287-7
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Neural replay is implicated in planning, where states relevant to a task goal are rapidly reactivated in sequence. It remains unclear whether, during planning, replay relates to an actual prospective choice. Here, using magnetoencephalography (MEG), we studied replay in human participants while they planned to either approach or avoid an uncertain environment containing paths leading to reward or punishment. We find evidence for forward sequential replay during planning, with rapid state-to-state transitions from 20 to 90 ms. Replay of rewarding paths was boosted, relative to aversive paths, before a decision to avoid and attenuated before a decision to approach. A trial-by-trial bias toward replaying prospective punishing paths predicted irrational decisions to approach riskier environments, an effect more pronounced in participants with higher trait anxiety. The findings indicate a coupling of replay with planned behavior, where replay prioritizes an online representation of a worst-case scenario for approaching or avoiding. During planning, the brain rapidly activates memories of paths leading to reward or punishment. In a new MEG study, the authors show that choosing to approach under uncertainty evokes reactivation of potential punishment, while avoiding reactivates forgone rewards.
引用
收藏
页码:627 / +
页数:22
相关论文
共 74 条
[61]   Replay of neuronal firing sequences in rat hippocampus during sleep following spatial experience [J].
Skaggs, WE ;
McNaughton, BL .
SCIENCE, 1996, 271 (5257) :1870-1873
[62]   COGNITIVE MAPS IN RATS AND MEN [J].
TOLMAN, EC .
PSYCHOLOGICAL REVIEW, 1948, 55 (04) :189-208
[63]   Localization of brain electrical activity via linearly constrained minimum variance spatial filtering [J].
VanVeen, BD ;
vanDrongelen, W ;
Yuchtman, M ;
Suzuki, A .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 1997, 44 (09) :867-880
[64]   Interactions among the medial prefrontal cortex, hippocampus and midline thalamus in emotional and cognitive processing in the rat [J].
Vertes, Robert P. .
NEUROSCIENCE, 2006, 142 (01) :1-20
[65]  
Wallach H., 2019, ADV NEURAL INFORM PR, P13
[66]   Hippocampal theta sequences reflect current goals [J].
Wikenheiser, Andrew M. ;
Redish, A. David .
NATURE NEUROSCIENCE, 2015, 18 (02) :289-294
[67]   REACTIVATION OF HIPPOCAMPAL ENSEMBLE MEMORIES DURING SLEEP [J].
WILSON, MA ;
MCNAUGHTON, BL .
SCIENCE, 1994, 265 (5172) :676-679
[68]   Episodic memory retrieval success is associated with rapid replay of episode content [J].
Wimmer, G. Elliott ;
Liu, Yunzhe ;
Vehar, Neza ;
Behrens, Timothy E. J. ;
Dolan, Raymond J. .
NATURE NEUROSCIENCE, 2020, 23 (08) :1025-+
[69]   Model-based aversive learning in humans is supported by preferential task state reactivation [J].
Wise, Toby ;
Liu, Yunzhe ;
Chowdhury, Fatima ;
Dolan, Raymond J. .
SCIENCE ADVANCES, 2021, 7 (31)
[70]   MEG beamforming using Bayesian PCA for adaptive data covariance matrix regularization [J].
Woolrich, Mark ;
Hunt, Laurence ;
Groves, Adrian ;
Barnes, Gareth .
NEUROIMAGE, 2011, 57 (04) :1466-1479