Striatal dopamine explains novelty-induced behavioral dynamics and individual variability in threat prediction

被引:43
作者
Akiti, Korleki [1 ]
Tsutsui-Kimura, Iku [1 ]
Xie, Yudi [1 ,2 ]
Mathis, Alexander [1 ,3 ,4 ]
Markowitz, Jeffrey E. [5 ,6 ]
Anyoha, Rockwell [5 ]
Datta, Sandeep Robert [5 ]
Mathis, Mackenzie Weygandt [3 ,4 ]
Uchida, Naoshige [1 ]
Watabe-Uchida, Mitsuko [1 ]
机构
[1] Harvard Univ, Ctr Brain Sci, Dept Mol & Cellular Biol, Cambridge, MA 02138 USA
[2] MIT, Dept Brain & Cognit Sci, Cambridge, MA 02139 USA
[3] Harvard Univ, Rowland Inst Harvard, Cambridge, MA 02138 USA
[4] Swiss Fed Inst Technol Lausanne, CH-1202 Geneva, Switzerland
[5] Harvard Med Sch, Dept Neurobiol, Boston, MA 02115 USA
[6] Georgia Inst Technol, Emory Sch Med, Wallace H Coulter Dept Biomed Engn, Atlanta, GA 30322 USA
基金
日本学术振兴会;
关键词
INTRINSIC MOTIVATION; SEX-DIFFERENCES; REWARD; NEURONS; EXPLORATION; CURIOSITY; INFORMATION; MECHANISMS; CIRCUITS; DEPENDS;
D O I
10.1016/j.neuron.2022.08.022
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Animals both explore and avoid novel objects in the environment, but the neural mechanisms that underlie these behaviors and their dynamics remain uncharacterized. Here, we used multi-point tracking (DeepLabCut) and behavioral segmentation (MoSeq) to characterize the behavior of mice freely interacting with a novel object. Novelty elicits a characteristic sequence of behavior, starting with investigatory approach and culminating in object engagement or avoidance. Dopamine in the tail of the striatum (TS) suppresses engagement, and dopamine responses were predictive of individual variability in behavior. Behavioral dy-namics and individual variability are explained by a reinforcement-learning (RL) model of threat prediction in which behavior arises from a novelty-induced initial threat prediction (akin to "shaping bonus") and a threat prediction that is learned through dopamine-mediated threat prediction errors. These results uncover an algorithmic similarity between reward-and threat-related dopamine sub-systems.
引用
收藏
页码:3789 / +
页数:26
相关论文
共 81 条
[1]   Sex differences in the brain: Implications for explaining autism [J].
Baron-Cohen, S ;
Knickmeyer, RC ;
Belmonte, MK .
SCIENCE, 2005, 310 (5749) :819-823
[2]   Novelty or Surprise? [J].
Barto, Andrew ;
Mirolli, Marco ;
Baldassarre, Gianluca .
FRONTIERS IN PSYCHOLOGY, 2013, 4
[3]  
BLANCHARD DC, 1991, ADV PHAR SC, P117
[4]   Midbrain Dopamine Neurons Signal Preference for Advance Information about Upcoming Rewards [J].
Bromberg-Martin, Ethan S. ;
Hikosaka, Okihide .
NEURON, 2009, 63 (01) :119-126
[5]   Neuron-type-specific signals for reward and punishment in the ventral tegmental area [J].
Cohen, Jeremiah Y. ;
Haesler, Sebastian ;
Vong, Linh ;
Lowell, Bradford B. ;
Uchida, Naoshige .
NATURE, 2012, 482 (7383) :85-U109
[6]  
Colas C, 2019, PR MACH LEARN RES, V97
[7]   DETERMINANTS OF EXPLORATION AND NEOPHOBIA [J].
COREY, DT .
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 1978, 2 (04) :235-253
[8]   Striatal circuits for reward learning and decision-making [J].
Cox, Julia ;
Witten, Ilana B. .
NATURE REVIEWS NEUROSCIENCE, 2019, 20 (08) :482-494
[9]   A distributional code for value in dopamine-based reinforcement learning [J].
Dabney, Will ;
Kurth-Nelson, Zeb ;
Uchida, Naoshige ;
Starkweather, Clara Kwon ;
Hassabis, Demis ;
Munos, Remi ;
Botvinick, Matthew .
NATURE, 2020, 577 (7792) :671-+
[10]  
Dai B, 2021, bioRxiv, DOI [10.1101/2021.06.22.449478, 10.1101/2021.06.22.449478, DOI 10.1101/2021.06.22.449478]