Neural systems underlying aversive conditioning in humans with primary and secondary reinforcers

被引:103
作者
Delgado, Mauricio R. [1 ]
Jou, Rita L. [2 ]
Phelps, Elizabeth A. [2 ,3 ]
机构
[1] Rutgers State Univ, Dept Psychol, Newark, NJ 07102 USA
[2] NYU, Dept Psychol, New York, NY 10003 USA
[3] NYU, Ctr Neural Sci, New York, NY 10003 USA
关键词
fear conditioning; striatum; amygdala; reinforcement; aversive learning; reward; insula; TEMPORAL DIFFERENCE MODELS; HUMAN AMYGDALA; PREDICTION ERRORS; PREFRONTAL CORTEX; DECISION-MAKING; DORSAL STRIATUM; REWARD; RESPONSES; FEAR; EXTINCTION;
D O I
10.3389/fnins.2011.00071
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Money is a secondary reinforcer commonly used across a range of disciplines in experimental paradigms investigating reward learning and decision-making. The effectiveness of monetary reinforcers during aversive learning and associated neural basis, however, remains a topic of debate. Specifically, it is unclear if the initial acquisition of aversive representations of monetary losses depends on similar neural systems as more traditional aversive conditioning that involves primary reinforcers. This study contrasts the efficacy of a biologically defined primary reinforcer (shock) and a socially defined secondary reinforcer (money) during aversive learning and its associated neural circuitry. During a two-part experiment, participants first played a gambling game where wins and losses were based on performance to gain an experimental bank. Participants were then exposed to two separate aversive conditioning sessions. In one session, a primary reinforcer (mild shock) served as an unconditioned stimulus (US) and was paired with one of two colored squares, the conditioned stimuli (CS+ and CS-, respectively). In another session, a secondary reinforcer (loss of money) served as the US and was paired with one of two different CS. Skin conductance responses were greater for CS+ compared to CS-trials irrespective of type of reinforcer. Neuroimaging results revealed that the striatum, a region typically linked with reward-related processing, was found to be involved in the acquisition of aversive conditioned response irrespective of reinforcer type. In contrast, the amygdala was involved during aversive conditioning with primary reinforcers, as suggested by both an exploratory fMRI analysis and a follow-up case study with a patient with bilateral amygdala damage. Taken together, these results suggest that learning about potential monetary losses may depend on reinforcement learning related systems, rather than on typical structures involved in more biologically based fears.
引用
收藏
页数:10
相关论文
共 51 条
  • [1] Is the human amygdala critical for the subjective experience of emotion? Evidence of intact dispositional affect in patients with amygdala lesions
    Anderson, AK
    Phelps, EA
    [J]. JOURNAL OF COGNITIVE NEUROSCIENCE, 2002, 14 (05) : 709 - 720
  • [2] Bechara A, 1999, J NEUROSCI, V19, P5473
  • [3] DOUBLE DISSOCIATION OF CONDITIONING AND DECLARATIVE KNOWLEDGE RELATIVE TO THE AMYGDALA AND HIPPOCAMPUS IN HUMANS
    BECHARA, A
    TRANEL, D
    DAMASIO, H
    ADOLPHS, R
    ROCKLAND, C
    DAMASIO, AR
    [J]. SCIENCE, 1995, 269 (5227) : 1115 - 1118
  • [4] Role of the amygdala in decisions under ambiguity and decisions under risk: Evidence from patients with Urbach-Wiethe disease
    Brand, Matthias
    Grabenhorst, Fabian
    Starcke, Katrin
    Vandekerckhove, Marie M. P.
    Markowitsch, Hans J.
    [J]. NEUROPSYCHOLOGIA, 2007, 45 (06) : 1305 - 1317
  • [5] Functional imaging of neural responses to expectancy and experience of monetary gains and losses
    Breiter, HC
    Aharon, I
    Kahneman, D
    Dale, A
    Shizgal, P
    [J]. NEURON, 2001, 30 (02) : 619 - 639
  • [6] Regional Response Differences Across the Human Amygdaloid Complex during Social Conditioning
    Davis, F. Caroline
    Johnstone, Tom
    Mazzulla, Emily C.
    Oler, Jonathan A.
    Whalen, Paul J.
    [J]. CEREBRAL CORTEX, 2010, 20 (03) : 612 - 621
  • [7] Amygdala damage eliminates monetary loss aversion
    De Martino, Benedetto
    Camerer, Colin F.
    Adolphs, Ralph
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2010, 107 (08) : 3788 - 3792
  • [8] The Neurobiology of Reference-Dependent Value Computation
    De Martino, Benedetto
    Kumaran, Dharshan
    Holt, Beatrice
    Dolan, Raymond J.
    [J]. JOURNAL OF NEUROSCIENCE, 2009, 29 (12) : 3833 - 3842
  • [9] Fear of losing money? Aversive conditioning with secondary reinforcers
    Delgado, M. R.
    Labouliere, C. D.
    Phelps, E. A.
    [J]. SOCIAL COGNITIVE AND AFFECTIVE NEUROSCIENCE, 2006, 1 (03) : 250 - 259
  • [10] The role of the striatum in aversive learning and aversive prediction errors
    Delgado, Mauricio R.
    Li, Jian
    Schiller, Daniela
    Phelps, Elizabeth A.
    [J]. PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 2008, 363 (1511) : 3787 - 3800