Experimental predictions drawn from a computational model of sign-trackers and goal-trackers

被引:17
作者
Lesaint, Florian [1 ,2 ]
Sigaud, Olivier [1 ,2 ]
Clark, Jeremy J. [3 ]
Flagel, Shelly B. [4 ,5 ,6 ]
Khamassi, Mehdi [1 ,2 ]
机构
[1] Univ Paris 06, ISIR, Univ Sorbonne, UMR 7222, F-75005 Paris, France
[2] CNRS, Inst Syst Intelligents & Robot, UMR 7222, F-75005 Paris, France
[3] Univ Washington, Dept Psychiat & Behav Sci, Seattle, WA USA
[4] Univ Michigan, Dept Psychiat, Ann Arbor, MI 48109 USA
[5] Univ Michigan, Mol & Behav Neurosci Inst, Ann Arbor, MI 48109 USA
[6] Univ Michigan, Dept Psychol, Ann Arbor, MI USA
关键词
Reinforcement learning; Dopamine; Pavlovian conditioning; Autoshaping; Model-based; Model-free; Factored representation; Sign-tracker; Goal-tracker; Conditioned approach; INCENTIVE SALIENCE; VENTRAL STRIATUM; INDIVIDUAL-DIFFERENCES; CENTRAL AMYGDALA; DOPAMINE; SYSTEMS; CUE; EXPRESSION;
D O I
10.1016/j.jphysparis.2014.06.001
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Gaining a better understanding of the biological mechanisms underlying the individual variation observed in response to rewards and reward cues could help to identify and treat individuals more prone to disorders of impulsive control, such as addiction. Variation in response to reward cues is captured in rats undergoing autoshaping experiments where the appearance of a lever precedes food delivery. Although no response is required for food to be delivered, some rats (goal-trackers) learn to approach and avidly engage the magazine until food delivery, whereas other rats (sign-trackers) come to approach and engage avidly the lever. The impulsive and often maladaptive characteristics of the latter response are reminiscent of addictive behaviour in humans. In a previous article, we developed a computational model accounting for a set of experimental data regarding sign-trackers and goal-trackers. Here we show new simulations of the model to draw experimental predictions that could help further validate or refute the model. In particular, we apply the model to new experimental protocols such as injecting flupentixol locally into the core of the nucleus accumbens rather than systemically, and lesioning of the core of the nucleus accumbens before or after conditioning. In addition, we discuss the possibility of removing the food magazine during the inter-trial interval. The predictions from this revised model will help us better understand the role of different brain regions in the behaviours expressed by sign-trackers and goal-trackers. (C) 2014 Elsevier Ltd. All rights reserved.
引用
收藏
页码:78 / 86
页数:9
相关论文
共 32 条
[1]  
[Anonymous], P C EV COMP IEEE
[2]  
[Anonymous], 2011, DECISION MAKING AFFE
[3]   Dissociating hippocampal and striatal contributions to sequential prediction learning [J].
Bornstein, Aaron M. ;
Daw, Nathaniel D. .
EUROPEAN JOURNAL OF NEUROSCIENCE, 2012, 35 (07) :1011-1023
[4]   A biologically inspired meta-control navigation system for the Psikharpax rat robot [J].
Caluwaerts, K. ;
Staffa, M. ;
N'Guyen, S. ;
Grand, C. ;
Dolle, L. ;
Favre-Felix, A. ;
Girard, B. ;
Khamassi, M. .
BIOINSPIRATION & BIOMIMETICS, 2012, 7 (02)
[5]   Pavlovian valuation systems in learning and decision making [J].
Clark, Jeremy J. ;
Hollon, Nick G. ;
Phillips, Paul E. M. .
CURRENT OPINION IN NEUROBIOLOGY, 2012, 22 (06) :1054-1061
[6]   Disruption of conditioned reward association by typical and atypical antipsychotics [J].
Danna, C. L. ;
Elmer, G. I. .
PHARMACOLOGY BIOCHEMISTRY AND BEHAVIOR, 2010, 96 (01) :40-47
[7]   Model-Based Influences on Humans' Choices and Striatal Prediction Errors [J].
Daw, Nathaniel D. ;
Gershman, Samuel J. ;
Seymour, Ben ;
Dayan, Peter ;
Dolan, Raymond J. .
NEURON, 2011, 69 (06) :1204-1215
[8]   Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control [J].
Daw, ND ;
Niv, Y ;
Dayan, P .
NATURE NEUROSCIENCE, 2005, 8 (12) :1704-1711
[9]   The misbehavior of value and the discipline of the will [J].
Dayan, Peter ;
Niv, Yael ;
Seymour, Ben ;
Daw, Nathaniel D. .
NEURAL NETWORKS, 2006, 19 (08) :1153-1160
[10]   A fast and elitist multiobjective genetic algorithm: NSGA-II [J].
Deb, K ;
Pratap, A ;
Agarwal, S ;
Meyarivan, T .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2002, 6 (02) :182-197