Reinforcement-conflict based control: An integrative model of error detection in anterior cingulate cortex

被引:5
|
作者
Zendehrouh, Sareh [1 ]
Gharibzadeh, Shahriar [1 ]
Towhidkhah, Farzad [1 ]
机构
[1] Amirkabir Univ Technol, Dept Biomed Engn, Tehran, Iran
关键词
Error related negativity; N200; Performance monitoring; Executive control; Computational model; REACTION-TIME TASKS; PREFRONTAL CORTEX; COGNITIVE CONTROL; PREDICTION ERROR; NEURAL SYSTEM; BASAL GANGLIA; GO/NO-GO; DOPAMINE; ERP; LIKELIHOOD;
D O I
10.1016/j.neucom.2013.06.020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The concepts of error detection and compensation play a key role in the studies of human brain behavior. In particular, studies of event-related brain potentials have discovered the presence of a component following errors named the error related negativity (ERN). According to the highly used theories of this field, the ERN can occur due to an error detection in reward prediction (the reinforcement learning theory) or conflict detection (the conflict monitoring theory). Since each of these theories has given numerous experimental validations, there is an urge to reconcile them. Although there have been efforts to integrate these two theories, the research in this field needs to be improved. The present study aims at integrating the above-mentioned theories by proposing a model that simulates the role of anterior cingulate cortex in performance monitoring and reinforcement-guided action selection. In this model, an executive control module uses the conflict signal and the reward prediction error to adjust the timing of the control and to regulate the strength of the control over other structures. The simulation results show that the proposed model can successfully produce the expected experimental results in a modified version of the Eriksen flanker task. (C) 2013 Elsevier B.V. All rights reserved.
引用
收藏
页码:140 / 149
页数:10
相关论文
共 50 条
  • [41] Anterior cingulate cortex activity can be independent of response conflict in Stroop-like tasks
    Roelofs, Ardi
    van Turennout, Miranda
    Coles, Michael G. H.
    PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2006, 103 (37) : 13884 - 13889
  • [42] Moral Conflict in Economic Decision Making: The Role of the Anterior Cingulate Cortex-Striatum Pathway
    Cui, Fang
    Huang, Xiaoxuan
    Li, Xiaoyun
    Liao, Chong
    Liu, Jie
    Luo, Yue-Jia
    CEREBRAL CORTEX, 2021, 31 (11) : 5121 - 5130
  • [43] Reward-based contextual learning supported by anterior cingulate cortex
    Akina Umemoto
    Azadeh HajiHosseini
    Michael E. Yates
    Clay B. Holroyd
    Cognitive, Affective, & Behavioral Neuroscience, 2017, 17 : 642 - 651
  • [44] Cortical control of aggression: GABA signalling in the anterior cingulate cortex
    Jager, Amanda
    Amiri, Houshang
    Bielczyk, Natalia
    van Heukelum, Sabrina
    Heerschap, Arend
    Aschrafi, Armaz
    Poelmans, Geert
    Buitelaar, Jan K.
    Kozicz, Tamas
    Glennon, Jeffrey C.
    EUROPEAN NEUROPSYCHOPHARMACOLOGY, 2020, 30 : 5 - 16
  • [45] A central role for anterior cingulate cortex in the control of pathological aggression
    van Heukelum, Sabrina
    Tulva, Kerli
    Geers, Femke E.
    van Dulm, Sanne
    Ruisch, I. Hyun
    Mill, Jonathan
    Viana, Joana F.
    Beckmann, Christian F.
    Buitelaar, Jan K.
    Poelmans, Geert
    Glennon, Jeffrey C.
    Vogt, Brent A.
    Havenith, Martha N.
    Franca, Arthur S. C.
    CURRENT BIOLOGY, 2021, 31 (11) : 2321 - +
  • [46] Chronic nicotine exposure impairs uncertainty modulation on reinforcement learning in anterior cingulate cortex and serotonin system
    Wei, Zhengde
    Han, Long
    Zhong, Xiuying
    Liu, Ying
    Zha, Rujing
    Wang, Ying
    Yang, Li-Zhuang
    Bu, Junjie
    Song, Hongwen
    Wang, Wenjuan
    Zhou, Yifeng
    Gao, Ping
    Zhang, Xiaochu
    NEUROIMAGE, 2018, 169 : 323 - 333
  • [47] The relationship between reaction time, error rate and anterior cingulate cortex activity
    Mulert, C
    Gallinat, J
    Dorn, H
    Herrmann, WM
    Winterer, G
    INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2003, 47 (02) : 175 - 183
  • [48] Emotion Triggers Executive Attention: Anterior Cingulate Cortex and Amygdala Responses to Emotional Words in a Conflict Task
    Kanske, Philipp
    Kotz, Sonja A.
    HUMAN BRAIN MAPPING, 2011, 32 (02) : 198 - 208
  • [49] Value, search, persistence and model updating in anterior cingulate cortex
    Kolling, Nils
    Wittmann, Marco K.
    Behrens, Tim E. J.
    Boorman, Erie D.
    Mars, Rogier B.
    Rushworth, Matthew F. S.
    NATURE NEUROSCIENCE, 2016, 19 (10) : 1280 - 1285
  • [50] Anterior cingulate cortex glutamate and its association with striatal functioning during cognitive control
    Naaijen, Jilly
    Lythgoe, David J.
    Zwiers, Marcel P.
    Hartman, Catharina A.
    Hoekstra, Pieter J.
    Buitelaar, Jan K.
    Aarts, Esther
    EUROPEAN NEUROPSYCHOPHARMACOLOGY, 2018, 28 (03) : 381 - 391