Dopamine dynamics in nucleus accumbens across reward-based learning of goal-directed whisker-to-lick sensorimotor transformations in mice

被引:0
作者
Huang, Jun [1 ,2 ,3 ]
Crochet, Sylvain [1 ]
Sandi, Carmen [2 ]
Petersen, Carl C. H. [1 ]
机构
[1] Ecole Polytech Fed Lausanne EPFL, Brain Mind Inst, Fac Life Sci, Lab Sensory Proc, Lausanne, Switzerland
[2] Ecole Polytech Fed Lausanne EPFL, Brain Mind Inst, Fac Life Sci, Lab Behav Genet, Lausanne, Switzerland
[3] Univ Bern, Dept Physiol, Bern, Switzerland
基金
瑞士国家科学基金会;
关键词
PROJECTION NEURONS; SIGNALS; CORTEX; CIRCUIT; INTEGRATION; MODULATION; ACTIVATION; SENSATION; DECISION; OUTPUT;
D O I
10.1016/j.heliyon.2024.e37831
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The synaptic and neuronal circuit mechanisms underlying reward-based learning remain to be fully determined. In the mammalian brain, dopamine release in nucleus accumbens is thought to contribute importantly to reward signals for learning and promoting synaptic plasticity. Here, through longitudinal fiber photometry of a genetically-encoded fluorescent sensor, we investigated dopamine signals in the nucleus accumbens of thirsty head-restrained mice as they learned to lick a liquid reward spout in response to single deflections of the C2 whisker across varying reward contingencies. Reward delivery triggered by well-timed licking drove fast transient dopamine increases in nucleus accumbens. On the other hand, unrewarded licking was overall associated with reduced dopamine sensor fluorescence, especially in trials where reward was unexpectedly omitted. The dopamine reward signal upon liquid delivery decreased within individual sessions as mice became sated. As mice learned to lick the reward spout in response to whisker deflection, a fast transient sensory-evoked dopamine signal developed, correlating with the learning of the whisker detection task across consecutive training days, as well as within single learning sessions. The well-defined behavioral paradigm involving a unitary stimulus of a single whisker as a reward-predicting cue along with precisely quantified licking allows untangling of sensory, motor and reward- related dopamine signals and how they evolve across the learning of whisker-dependent goal-directed sensorimotor transformations. Our longitudinal measurements of dopamine dynamics across reward-based learning are overall consistent with the hypothesis that dopamine could play an important role as a reward signal for reinforcement learning.
引用
收藏
页数:21
相关论文
共 81 条
[71]   Phasic Firing in Dopaminergic Neurons Is Sufficient for Behavioral Conditioning [J].
Tsai, Hsing-Chen ;
Zhang, Feng ;
Adamantidis, Antoine ;
Stuber, Garret D. ;
Bonci, Antonello ;
de Lecea, Luis ;
Deisseroth, Karl .
SCIENCE, 2009, 324 (5930) :1080-1084
[72]   Directed Evolution of a Selective and Sensitive Serotonin Sensor via Machine Learning [J].
Unger, Elizabeth K. ;
Keller, Jacob P. ;
Altermatt, Michael ;
Liang, Ruqiang ;
Matsui, Aya ;
Dong, Chunyang ;
Hon, Olivia J. ;
Yao, Zi ;
Sun, Junqing ;
Banala, Samba ;
Flanigan, Meghan E. ;
Jaffe, David A. ;
Hartanto, Samantha ;
Carlen, Jane ;
Mizuno, Grace O. ;
Borden, Phillip M. ;
Shivange, Amol, V ;
Cameron, Lindsay P. ;
Sinning, Steffen ;
Underhill, Suzanne M. ;
Olson, David E. ;
Amara, Susan G. ;
Lang, Duncan Temple ;
Rudnick, Gary ;
Marvin, Jonathan S. ;
Lavis, Luke D. ;
Lester, Henry A. ;
Alvarez, Veronica A. ;
Fisher, Andrew J. ;
Prescher, Jennifer A. ;
Kash, Thomas L. ;
Yarov-Yarovoy, Vladimir ;
Gradinaru, Viviana ;
Looger, Loren L. ;
Tian, Lin .
CELL, 2020, 183 (07) :1986-+
[73]   WiChR, a highly potassium-selective channelrhodopsin for low-light one- and two-photon inhibition of excitable cells [J].
Vierock, Johannes ;
Peter, Enrico ;
Grimm, Christiane ;
Rozenberg, Andrey ;
Chen, I-Wen ;
Tillert, Linda ;
Scalise, Alejandro G. Castro ;
Casini, Marilu ;
Augustin, Sandra ;
Tanese, Dimitrii ;
Forget, Benoit C. ;
Peyronnet, Remi ;
Schneider-Warme, Franziska ;
Emiliani, Valentina ;
Beja, Oded ;
Hegemann, Peter .
SCIENCE ADVANCES, 2022, 8 (49)
[74]   A genetically encoded sensor for measuring serotonin dynamics [J].
Wan, Jinxia ;
Peng, Wanling ;
Li, Xuelin ;
Qian, Tongrui ;
Song, Kun ;
Zeng, Jianzhi ;
Deng, Fei ;
Hao, Suyu ;
Feng, Jiesi ;
Zhang, Peng ;
Zhang, Yajun ;
Zou, Jing ;
Pan, Sunlei ;
Shin, Mimi ;
Venton, B. Jill ;
Zhu, J. Julius ;
Jing, Miao ;
Xu, Min ;
Li, Yulong .
NATURE NEUROSCIENCE, 2021, 24 (05) :746-752
[75]   Whole-Brain Mapping of Direct Inputs to Midbrain Dopamine Neurons [J].
Watabe-Uchida, Mitsuko ;
Zhu, Lisa ;
Ogawa, Sachie K. ;
Vamanrao, Archana ;
Uchida, Naoshige .
NEURON, 2012, 74 (05) :858-873
[76]   A bistable inhibitory optoGPCR for multiplexed optogenetic control of neural circuits [J].
Wietek, Jonas ;
Nozownik, Adrianna ;
Pulin, Mauro ;
Saraf-Sinik, Inbar ;
Matosevich, Noa ;
Gowrishankar, Raajaram ;
Gat, Asaf ;
Malan, Daniela ;
Brown, Bobbie J. ;
Dine, Julien ;
Imambocus, Bibi Nusreen ;
Levy, Rivka ;
Sauter, Kathrin ;
Litvin, Anna ;
Regev, Noa ;
Subramaniam, Suraj ;
Abrera, Khalid ;
Summarli, Dustin ;
Goren, Eva Madeline ;
Mizrachi, Gili ;
Bitton, Eyal ;
Benjamin, Asaf ;
Copits, Bryan A. ;
Sasse, Philipp ;
Rost, Benjamin R. ;
Schmitz, Dietmar ;
Bruchas, Michael R. ;
Soba, Peter ;
Oren-Suissa, Meital ;
Nir, Yuval ;
Wiegert, J. Simon ;
Yizhar, Ofer .
NATURE METHODS, 2024, 21 (07) :1275-1287
[77]   A critical time window for dopamine actions on the structural plasticity of dendritic spines [J].
Yagishita, Sho ;
Hayashi-Takagi, Akiko ;
Ellis-Davies, Graham C. R. ;
Urakubo, Hidetoshi ;
Ishii, Shin ;
Kasai, Haruo .
SCIENCE, 2014, 345 (6204) :1616-1620
[78]   Origins of choice-related activity in mouse somatosensory cortex [J].
Yang, Hongdian ;
Kwon, Sung E. ;
Severson, Kyle S. ;
O'Connor, Daniel H. .
NATURE NEUROSCIENCE, 2016, 19 (01) :127-+
[79]   Opponent and bidirectional control of movement velocity in the basal ganglia [J].
Yttri, Eric A. ;
Dudman, Joshua T. .
NATURE, 2016, 533 (7603) :402-+
[80]   Dorsolateral Striatum is a Bottleneck for Responding to Task-Relevant Stimuli in a Learned Whisker Detection Task in Mice [J].
Zareian, Behzad ;
Lam, Angelina ;
Zagha, Edward .
JOURNAL OF NEUROSCIENCE, 2023, 43 (12) :2126-2139