A Dual Role Hypothesis of the Cortico-Basal-Ganglia Pathways: Opponency and Temporal Difference Through Dopamine and Adenosine

被引:10
|
作者
Morita, Kenji [1 ,2 ]
Kawaguchi, Yasuo [3 ,4 ]
机构
[1] Univ Tokyo, Grad Sch Educ, Phys & Hlth Educ, Tokyo, Japan
[2] Univ Tokyo, Inst Adv Study, IRCN, WPI, Tokyo, Japan
[3] Natl Inst Physiol Sci, Div Cerebral Circuitry, Okazaki, Aichi, Japan
[4] Grad Univ Adv Studies, Dept Physiol Sci, Okazaki, Aichi, Japan
来源
FRONTIERS IN NEURAL CIRCUITS | 2019年 / 12卷
关键词
reinforcement learning; reward prediction error; cost; basal ganglia; dopamine; adenosine; RAT NUCLEUS-ACCUMBENS; A(2A) RECEPTORS; CORTICOSTRIATAL NEURONS; PROJECTION NEURONS; PREDICTION ERRORS; STRIATAL DIRECT; REINFORCEMENT; MODULATION; PLASTICITY; SYSTEMS;
D O I
10.3389/fncir.2018.00111
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The hypothesis that the basal-ganglia direct and indirect pathways represent goodness (or benefit) and badness (or cost) of options, respectively, explains a wide range of phenomena. However, this hypothesis, named the Opponent Actor Learning (OpAL), still has limitations. Structurally, the OpAL model does not incorporate differentiation of the two types of cortical inputs to the basal-ganglia pathways received from intratelencephalic (IT) and pyramidal-tract (PT) neurons. Functionally, the OpAL model does not describe the temporal-difference (TD)-type reward-prediction-error (RPE), nor explains how RPE is calculated in the circuitry connecting to the DA neurons. In fact, there is a different hypothesis on the basal-ganglia pathways and DA, named the Cortico-Striatal-Temporal-Difference (CS-TD) model. The CS-TD model differentiates the IT and PT inputs, describes the TD-type RPE, and explains how TD-RPE is calculated. However, a critical difficulty in this model lies in its assumption that DA induces the same direction of plasticity in both direct and indirect pathways, which apparently contradicts the experimentally observed opposite effects of DA on these pathways. Here, we propose a new hypothesis that integrates the OpAL and CS-TD models. Specifically, we propose that the IT-basal-ganglia pathways represent goodness/badness of current options while the PT-indirect pathway represents the overall value of the previously chosen option, and both of these have influence on the DA neurons, through the basal-ganglia output, so that a variant of TD-RPE is calculated. A key assumption is that opposite directions of plasticity are induced upon phasic activation of DA neurons in the IT-indirect pathway and PT-indirect pathway because of different profiles of IT and PT inputs. Specifically, at PT -> indirect-pathway-medium-spiny-neuron (iMSN) synapses, sustained glutamatergic inputs generate rich adenosine, which allosterically prevents DA-D2 receptor signaling and instead favors adenosine-A2A receptor signaling. Then, phasic DA-induced phasic adenosine, which reflects TD-RPE, causes long-term synaptic potentiation. In contrast, at IT -> iMSN synapses where adenosine is scarce, phasic DA causes long-term synaptic depression via D2 receptor signaling. This new Opponency and Temporal-Difference (OTD) model provides unique predictions, part of which is potentially in line with recently reported activity patterns of neurons in the globus pallidus externus on the indirect pathway.
引用
收藏
页数:11
相关论文
共 5 条
  • [1] Ongoing monitoring of mindwandering in avoidant grief through cortico-basal-ganglia interactions
    Schneck, Noam
    Tu, Tao
    Haufe, Stefan
    Bonanno, George A.
    GalfaIvy, Hanga
    Ochsner, Kevin N.
    Mann, J. John
    Sajda, Paul
    SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE, 2019, 14 (02) : 163 - 172
  • [2] The cortico-basal ganglia-thalamocortical circuit with synaptic plasticity. II. Mechanism of synergistic modulation of thalamic activity via the direct and indirect pathways through the basal ganglia
    Silkis, I
    BIOSYSTEMS, 2001, 59 (01) : 7 - 14
  • [3] Striosomes control dopamine via dual pathways paralleling canonical basal ganglia circuits
    Lazaridis, Iakovos
    Crittenden, Jill R.
    Ahn, Gun
    Hirokane, Kojiro
    Wickersham, Ian R.
    Yoshida, Tomoko
    Mahar, Ara
    Skara, Vasiliki
    Loftus, Johnny H.
    Parvataneni, Krishna
    Meletis, Konstantinos
    Ting, Jonathan T.
    Hueske, Emily
    Matsushima, Ayano
    Graybiel, Ann M.
    CURRENT BIOLOGY, 2024, 34 (22) : 5263 - 5283.e8
  • [4] A Computational Model of Basal Ganglia Circuits Investigating the Role of Dopamine on Direct and Indirect Pathways
    Elibol, Rahmi
    Sengor, Neslihan Serap
    2015 MEDICAL TECHNOLOGIES NATIONAL CONFERENCE (TIPTEKNO), 2015,
  • [5] Altered Dynamic Information Flow through the Cortico-Basal Ganglia Pathways Mediates Parkinson's Disease Symptoms
    Chiken, Satomi
    Takada, Masahiko
    Nambu, Atsushi
    CEREBRAL CORTEX, 2021, 31 (12) : 5363 - 5380