The role of learning-related dopamine signals in addiction vulnerability

被引:62
作者
Huys, Quentin J. M. [1 ,2 ,3 ]
Tobler, Philippe N. [4 ]
Hasler, Gregor [5 ]
Flagel, Shelly B. [6 ,7 ]
机构
[1] Swiss Fed Inst Technol, Dept Biomed Engn, Translat Neuromodeling Unit, Zurich, Switzerland
[2] Univ Zurich, Zurich, Switzerland
[3] Univ Zurich, Hosp Psychiat, Dept Psychiat Psychosomat & Psychotherapy, Zurich, Switzerland
[4] Univ Zurich, Lab Social & Neural Syst Res, Dept Econ, Zurich, Switzerland
[5] Univ Bern, Dept Psychiat, Bern, Switzerland
[6] Univ Michigan, Dept Psychiat, Ann Arbor, MI 48109 USA
[7] Univ Michigan, Mol Behav Neurosci Inst, Ann Arbor, MI 48109 USA
来源
DOPAMINE | 2014年 / 211卷
关键词
dopamine; reinforcement learning; incentive salience; addiction; model-free; prediction error; sign-tracking; NUCLEUS-ACCUMBENS CORE; PAVLOVIAN-INSTRUMENTAL TRANSFER; VENTRAL TEGMENTAL AREA; MEDIAL PREFRONTAL CORTEX; OBSESSIVE-COMPULSIVE DISORDER; PREDICTION ERROR HYPOTHESIS; TEMPORAL DIFFERENCE MODELS; OUTCOME-SPECIFIC FORMS; HUMAN DRUG-SEEKING; INCENTIVE SALIENCE;
D O I
10.1016/B978-0-444-63425-2.00003-9
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Dopaminergic signals play a mathematically precise role in reward-related learning, and variations in dopaminergic signaling have been implicated in vulnerability to addiction. Here, we provide a detailed overview of the relationship between theoretical, mathematical, and experimental accounts of phasic dopamine signaling, with implications for the role of learning-related dopamine signaling in addiction and related disorders. We describe the theoretical and behavioral characteristics of model-free learning based on errors in the prediction of reward, including step-by-step explanations of the underlying equations. We then use recent insights from an animal model that highlights individual variation in learning during a Pavlovian conditioning paradigm to describe overlapping aspects of incentive salience attribution and model-free learning. We argue that this provides a computationally coherent account of some features of addiction.
引用
收藏
页码:31 / 77
页数:47
相关论文
共 256 条
  • [1] Prediction error as a linear function of reward probability is coded in human nucleus accumbens
    Abler, Birgit
    Walter, Henrik
    Erk, Susanne
    Kammerer, Hannes
    Spitzer, Manfred
    [J]. NEUROIMAGE, 2006, 31 (02) : 790 - 795
  • [2] [Anonymous], 1967, S PUN
  • [3] [Anonymous], 1996, Neuro-dynamic programming
  • [4] [Anonymous], 1991, Do the Right Thing: Studies in Limited Rationality
  • [5] Balleine BW, 2009, NEUROECONOMICS: DECISION MAKING AND THE BRAIN, P367, DOI 10.1016/B978-0-12-374176-9.00024-5
  • [6] NEURONLIKE ADAPTIVE ELEMENTS THAT CAN SOLVE DIFFICULT LEARNING CONTROL-PROBLEMS
    BARTO, AG
    SUTTON, RS
    ANDERSON, CW
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1983, 13 (05): : 834 - 846
  • [7] Statistics of midbrain dopamine neuron spike trains in the awake primate
    Bayer, Hannah M.
    Lau, Brian
    Glimcher, Paul W.
    [J]. JOURNAL OF NEUROPHYSIOLOGY, 2007, 98 (03) : 1428 - 1439
  • [8] Midbrain dopamine neurons encode a quantitative reward prediction error signal
    Bayer, HM
    Glimcher, PW
    [J]. NEURON, 2005, 47 (01) : 129 - 141
  • [9] Ventral Striatal Activation During Reward Anticipation Correlates with Impulsivity in Alcoholics
    Beck, Anne
    Schlagenhauf, Florian
    Wuestenberg, Torsten
    Hein, Jakob
    Kienast, Thorsten
    Kahnt, Thorsten
    Schmack, Katharina
    Haegele, Claudia
    Knutson, Brian
    Heinz, Andreas
    Wrase, Jana
    [J]. BIOLOGICAL PSYCHIATRY, 2009, 66 (08) : 734 - 742
  • [10] Novelty seeking, incentive salience and acquisition of cocaine self-administration in the rat
    Beckmann, Joshua S.
    Marusich, Julie A.
    Gipson, Cassandra D.
    Bardo, Michael T.
    [J]. BEHAVIOURAL BRAIN RESEARCH, 2011, 216 (01) : 159 - 165