Neural coding of reward-prediction error signals during classical conditioning with attractive faces

被引:130
|
作者
Bray, Signe
O'Doherty, John
机构
[1] CALTECH, Computat & Neural Syst, Pasadena, CA 91125 USA
[2] CALTECH, Div Humanities & Social Sci, Pasadena, CA 91125 USA
关键词
TEMPORAL DIFFERENCE MODELS; ORBITOFRONTAL CORTEX; UNCONDITIONED STIMULUS; FACIAL EXPRESSIONS; AMYGDALA ACTIVITY; PERCEPTION; RESPONSES; DURATION; BEAUTY; PREFERENCE;
D O I
10.1152/jn.01211.2006
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Attractive faces can be considered to be a form of visual reward. Previous imaging studies have reported activity in reward structures including orbitofrontal cortex and nucleus accumbens during presentation of attractive faces. Given that these stimuli appear to act as rewards, we set out to explore whether it was possible to establish conditioning in human subjects by pairing presentation of arbitrary affectively neutral stimuli with subsequent presentation of attractive and unattractive faces. Furthermore, we scanned human subjects with functional magnetic resonance imaging (fMRI) while they underwent this conditioning procedure to determine whether a reward-prediction error signal is engaged during learning with attractive faces as is known to be the case for learning with other types of reward such as juice and money. Subjects showed changes in behavioral ratings to the conditioned stimuli (CS) when comparing post- to preconditioning evaluations, notably for those CSs paired with attractive female faces. We used a simple Rescorla-Wagner learning model to generate a reward-prediction error signal and entered this into a regression analysis with the fMRI data. We found significant prediction error-related activity in the ventral striatum during conditioning with attractive compared with unattractive faces. These findings suggest that an arbitrary stimulus can acquire conditioned value by being paired with pleasant visual stimuli just as with other types of reward such as money or juice. This learning process elicits a reward-prediction error signal in a main target structure of dopamine neurons: the ventral striatum. The findings we describe here may provide insights into the neural mechanisms tapped into by advertisers seeking to influence behavioral preferences by repeatedly exposing consumers to simple associations between products and rewarding visual stimuli such as pretty faces.
引用
收藏
页码:3036 / 3045
页数:10
相关论文
共 50 条
  • [1] Dopamine reward prediction error coding
    Schultz, Wolfram
    DIALOGUES IN CLINICAL NEUROSCIENCE, 2016, 18 (01) : 23 - 32
  • [2] A VTA GABAergic computational model of dissociated reward prediction error computation in classical conditioning
    Kaushik, Pramod
    Naude, Jeremie
    Raju, Surampudi Bapi
    Alexandre, Frederic
    NEUROBIOLOGY OF LEARNING AND MEMORY, 2022, 193
  • [3] Classical conditioning drives learned reward prediction signals in climbing fibers across the lateral cerebellum
    Heffley, William
    Hull, Court
    ELIFE, 2019, 8
  • [4] Reward prediction error coding in striatal neurons
    Oyama, Kei
    Hernadi, Istvan
    Iijima, Toshio
    Tsutsui, Ken-Ichiro
    NEUROSCIENCE RESEARCH, 2010, 68 : E288 - E289
  • [5] Neural Circuitry of Reward Prediction Error
    Watabe-Uchida, Mitsuko
    Eshel, Neir
    Uchida, Naoshige
    ANNUAL REVIEW OF NEUROSCIENCE, VOL 40, 2017, 40 : 373 - 394
  • [6] Reward Prediction Error Coding in Dorsal Striatal Neurons
    Oyama, Kei
    Hernadi, Istvan
    Iijima, Toshio
    Tsutsui, Ken-Ichiro
    JOURNAL OF NEUROSCIENCE, 2010, 30 (34): : 11447 - 11457
  • [7] Abnormal Reward Prediction Error Signals in Depression and Schizophrenia
    Gradin, Victoria
    Kumar, Poornima
    Waiter, Gordon
    Ahearn, Trevor
    Reid, Ian
    Stickle, Catriona
    Milders, Martin
    Hall, Jeremy
    Steele, Douglas
    BIOLOGICAL PSYCHIATRY, 2010, 67 (09) : 137S - 137S
  • [8] Reward prediction error signals by reticular formation neurons
    Puryear, Corey B.
    Mizumori, Sheri J. Y.
    LEARNING & MEMORY, 2008, 15 (12) : 895 - 898
  • [9] Reward Prediction Error Signals are Meta-Representational
    Shea, Nicholas
    NOUS, 2014, 48 (02): : 314 - 341
  • [10] Abnormalities in reward prediction error signals in depression and schizophrenia
    Gradin, V.
    Kumar, P.
    Waiter, G.
    Ahearn, T.
    Reid, I.
    Stickle, C.
    Milders, M.
    Hall, J.
    Steele, J. D.
    EUROPEAN NEUROPSYCHOPHARMACOLOGY, 2010, 20 : S173 - S173