Reinforcement-conflict based control: An integrative model of error detection in anterior cingulate cortex

被引:5
|
作者
Zendehrouh, Sareh [1 ]
Gharibzadeh, Shahriar [1 ]
Towhidkhah, Farzad [1 ]
机构
[1] Amirkabir Univ Technol, Dept Biomed Engn, Tehran, Iran
关键词
Error related negativity; N200; Performance monitoring; Executive control; Computational model; REACTION-TIME TASKS; PREFRONTAL CORTEX; COGNITIVE CONTROL; PREDICTION ERROR; NEURAL SYSTEM; BASAL GANGLIA; GO/NO-GO; DOPAMINE; ERP; LIKELIHOOD;
D O I
10.1016/j.neucom.2013.06.020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The concepts of error detection and compensation play a key role in the studies of human brain behavior. In particular, studies of event-related brain potentials have discovered the presence of a component following errors named the error related negativity (ERN). According to the highly used theories of this field, the ERN can occur due to an error detection in reward prediction (the reinforcement learning theory) or conflict detection (the conflict monitoring theory). Since each of these theories has given numerous experimental validations, there is an urge to reconcile them. Although there have been efforts to integrate these two theories, the research in this field needs to be improved. The present study aims at integrating the above-mentioned theories by proposing a model that simulates the role of anterior cingulate cortex in performance monitoring and reinforcement-guided action selection. In this model, an executive control module uses the conflict signal and the reward prediction error to adjust the timing of the control and to regulate the strength of the control over other structures. The simulation results show that the proposed model can successfully produce the expected experimental results in a modified version of the Eriksen flanker task. (C) 2013 Elsevier B.V. All rights reserved.
引用
收藏
页码:140 / 149
页数:10
相关论文
共 50 条
  • [21] Reward-based contextual learning supported by anterior cingulate cortex
    Umemoto, Akina
    HajiHosseini, Azadeh
    Yates, Michael E.
    Holroyd, Clay B.
    COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2017, 17 (03) : 642 - 651
  • [22] Reinforcement learning signals in the anterior cingulate cortex code for others' false beliefs
    Apps, M. A. J.
    Green, R.
    Ramnani, N.
    NEUROIMAGE, 2013, 64 : 1 - 9
  • [23] Dorsal anterior cingulate cortex integrates reinforcement history to guide voluntary behaviour
    Holroyd, Clay B.
    Coles, Michael G. H.
    CORTEX, 2008, 44 (05) : 548 - 559
  • [24] Errors without conflict: Implications for performance monitoring theories of anterior cingulate cortex
    van Veen, V
    Holroyd, CB
    Cohen, JD
    Stenger, VA
    Carter, CS
    BRAIN AND COGNITION, 2004, 56 (02) : 267 - 276
  • [25] Impaired Error Awareness and Anterior Cingulate Cortex Hypoactivity in Chronic Cannabis Users
    Robert Hester
    Liam Nestor
    Hugh Garavan
    Neuropsychopharmacology, 2009, 34 : 2450 - 2458
  • [26] Hierarchical control over foraging behavior by anterior cingulate cortex
    Alejandro, Ricardo J.
    Holroyd, Clay B.
    NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2024, 160
  • [27] Impaired Error Awareness and Anterior Cingulate Cortex Hypoactivity in Chronic Cannabis Users
    Hester, Robert
    Nestor, Liam
    Garavan, Hugh
    NEUROPSYCHOPHARMACOLOGY, 2009, 34 (11) : 2450 - 2458
  • [28] Conflict effects without conflict in anterior cingulate cortex: Multiple response effects and context specific representations
    Brown, Joshua W.
    NEUROIMAGE, 2009, 47 (01) : 334 - 341
  • [29] Error Effects in Anterior Cingulate Cortex Reverse when Error Likelihood Is High
    Jessup, Ryan K.
    Busemeyer, Jerome R.
    Brown, Joshua W.
    JOURNAL OF NEUROSCIENCE, 2010, 30 (09) : 3467 - 3472
  • [30] Attentional Effects of Lesions to the Anterior Cingulate Cortex: How Prior Reinforcement Influences Distractibility
    Newman, Lori A.
    McGaughy, Jill
    BEHAVIORAL NEUROSCIENCE, 2011, 125 (03) : 360 - 371