A Neurocomputational Model for Cocaine Addiction

被引:31
作者
Dezfouli, Amir [1 ]
Piray, Payam [1 ]
Keramati, Mohammad Mahdi [2 ]
Ekhtiari, Hamed [3 ]
Lucas, Caro [1 ]
Mokri, Azarakhsh [4 ,5 ]
机构
[1] Univ Tehran, Control & Intelligent Proc Ctr Excellence, Sch Elect & Comp Engn, Tehran, Iran
[2] Sharif Univ Technol, Sch Management & Econ, Tehran, Iran
[3] Iranian Natl Ctr Addict Studies, Neurocognit Lab, Tehran, Iran
[4] Iranian Natl Ctr Addict Studies, Dept Clin Sci, Tehran, Iran
[5] Univ Tehran Med Sci, Dept Psychiat, Tehran, Iran
关键词
D O I
10.1162/neco.2009.10-08-882
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Based on the dopamine hypotheses of cocaine addiction and the assumption of decrement of brain reward system sensitivity after long-term drug exposure, we propose a computational model for cocaine addiction. Utilizing average reward temporal difference reinforcement learning, we incorporate the elevation of basal reward threshold after long-term drug exposure into the model of drug addiction proposed by Redish. Our model is consistent with the animal models of drug seeking under punishment. In the case of nondrug reward, the model explains increased impulsivity after long-term drug exposure. Furthermore, the existence of a blocking effect for cocaine is predicted by our model.
引用
收藏
页码:2869 / 2893
页数:25
相关论文
共 57 条
  • [1] Transition to drug addiction: a negative reinforcement model based on an allostatic decrease in reward function
    Ahmed, SH
    Koob, GF
    [J]. PSYCHOPHARMACOLOGY, 2005, 180 (03) : 473 - 490
  • [2] Transition from moderate to excessive drug intake: Change in hedonic set point
    Ahmed, SH
    Koob, GF
    [J]. SCIENCE, 1998, 282 (5387) : 298 - 300
  • [3] Long-lasting increase in the set point for cocaine self-administration after escalation in rats
    Ahmed, SH
    Koob, GF
    [J]. PSYCHOPHARMACOLOGY, 1999, 146 (03) : 303 - 312
  • [4] Neuroscience - Addiction as compulsive reward prediction
    Ahmed, SH
    [J]. SCIENCE, 2004, 306 (5703) : 1901 - 1902
  • [5] [Anonymous], 2000, DIAGN STAT MAN MENT, DOI DOI 10.1176/APPI.BOOKS.9780890425787
  • [6] Preferential enhancement of dopamine transmission within the nucleus accumbens shell by cocaine is attributable to a direct increase in phasic dopamine release events
    Aragona, Brandon J.
    Cleaveland, Nathan A.
    Stuber, Garret D.
    Day, Jeremy J.
    Carelli, Regina M.
    Wightman, R. Mark
    [J]. JOURNAL OF NEUROSCIENCE, 2008, 28 (35) : 8821 - 8831
  • [7] Abolished cocaine reward in mice with a cocaine-insensitive dopamine transporter
    Chen, Rong
    Tilley, Michael R.
    Wei, Hua
    Zhou, Fuwen
    Zhou, Fu-Ming
    Ching, San
    Quan, Ning
    Stephens, Robert L.
    Hill, Erik R.
    Nottoli, Timothy
    Han, Dawn D.
    Gu, Howard H.
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2006, 103 (24) : 9333 - 9338
  • [8] Daruna JH, 1993, IMPULSIVE CLIENT THE, P23, DOI DOI 10.1037/10500-002
  • [9] Solving semi-Markov decision problems using average reward reinforcement learning
    Das, TK
    Gosavi, A
    Mahadevan, S
    Marchalleck, N
    [J]. MANAGEMENT SCIENCE, 1999, 45 (04) : 560 - 574
  • [10] Daw N.D., 2003, THESIS CARNEGIE MELL