Hierarchical Error Representation: A Computational Model of Anterior Cingulate and Dorsolateral Prefrontal Cortex

被引:75
作者
Alexander, William H. [1 ,2 ]
Brown, Joshua W. [1 ]
机构
[1] Indiana Univ, Dept Psychol & Brain Sci, Bloomington, IN 47405 USA
[2] Univ Ghent, Dept Expt Psychol, B-9000 Ghent, Belgium
关键词
WORKING-MEMORY; COGNITIVE CONTROL; FRONTAL-CORTEX; FUNCTIONAL-ORGANIZATION; INTEGRATIVE THEORY; NEURAL MECHANISMS; DOPAMINE NEURONS; DECISION-MAKING; TERM-MEMORY; ATTENTION;
D O I
10.1162/NECO_a_00779
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anterior cingulate and dorsolateral prefrontal cortex (ACC and dlPFC, respectively) are core components of the cognitive control network. Activation of these regions is routinely observed in tasks that involve monitoring the external environment and maintaining information in order to generate appropriate responses. Despite the ubiquity of studies reporting coactivation of these two regions, a consensus on how they interact to support cognitive control has yet to emerge. In this letter, we present a new hypothesis and computational model of ACC and dlPFC. The error representation hypothesis states that multidimensional error signals generated by ACC in response to surprising outcomes are used to train representations of expected error in dlPFC, which are then associated with relevant task stimuli. Error representations maintained in dlPFC are in turn used to modulate predictive activity in ACC in order to generate better estimates of the likely outcomes of actions. We formalize the error representation hypothesis in a new computational model based on our previous model of ACC. The hierarchical error representation (HER) model of ACC/dlPFC suggests a mechanism by which hierarchically organized layers within ACC and dlPFC interact in order to solve sophisticated cognitive tasks. In a series of simulations, we demonstrate the ability of the HER model to autonomously learn to perform structured tasks in a manner comparable to human performance, and we show that the HER model outperforms current deep learning networks by an order of magnitude.
引用
收藏
页码:2354 / 2410
页数:57
相关论文
共 50 条
  • [31] Anterior cingulate and medial prefrontal cortex oscillations underlie learning alterations in trait anxiety in humans
    Hein, Thomas. P. P.
    Gong, Zheng
    Ivanova, Marina
    Fedele, Tommaso
    Nikulin, Vadim
    Ruiz, Maria Herrojo
    COMMUNICATIONS BIOLOGY, 2023, 6 (01)
  • [32] Reinforcement-conflict based control: An integrative model of error detection in anterior cingulate cortex
    Zendehrouh, Sareh
    Gharibzadeh, Shahriar
    Towhidkhah, Farzad
    NEUROCOMPUTING, 2014, 123 : 140 - 149
  • [33] Chronometric TMS-fMRI of personalized left dorsolateral prefrontal target reveals state-dependency of subgenual anterior cingulate cortex effects
    Grosshagauer, Sarah
    Woletz, Michael
    Vasileiadi, Maria
    Linhardt, David
    Nohava, Lena
    Schuler, Anna-Lisa
    Windischberger, Christian
    Williams, Nolan
    Tik, Martin
    MOLECULAR PSYCHIATRY, 2024, 29 (09) : 2678 - 2688
  • [34] The effect of regulatory mode on procrastination: Bi-stable parahippocampus connectivity with dorsal anterior cingulate and anterior prefrontal cortex
    Zhang, Chenyan
    Ni, Yan
    Feng, Tingyong
    BEHAVIOURAL BRAIN RESEARCH, 2017, 329 : 51 - 57
  • [35] Roles of Ventromedial Prefrontal Cortex and Anterior Cingulate in Subjective Valuation of Prospective Effort
    Hogan, Patrick S.
    Galaro, Joseph K.
    Chib, Vikram S.
    CEREBRAL CORTEX, 2019, 29 (10) : 4277 - 4290
  • [36] Task-dependent response conflict monitoring and cognitive control in anterior cingulate and dorsolateral prefrontal cortices
    Kim, Chobok
    Chung, Chongwook
    Kim, Jeounghoon
    BRAIN RESEARCH, 2013, 1537 : 216 - 223
  • [37] A Novel Neural Prediction Error Found in Anterior Cingulate Cortex Ensembles
    Hyman, James Michael
    Holroyd, Clay Brian
    Seamans, Jeremy Keith
    NEURON, 2017, 95 (02) : 447 - +
  • [38] Impaired rapid error monitoring but intact error signaling following rostral anterior cingulate cortex lesions in humans
    Maier, Martin E.
    Di Gregorio, Francesco
    Muricchio, Teresa
    Di Pellegrino, Giuseppe
    FRONTIERS IN HUMAN NEUROSCIENCE, 2015, 9
  • [39] Bilingual Language Control in Perception versus Action: MEG Reveals Comprehension Control Mechanisms in Anterior Cingulate Cortex and Domain-General Control of Production in Dorsolateral Prefrontal Cortex
    Blanco-Elorrieta, Esti
    Pylkkaenen, Liina
    JOURNAL OF NEUROSCIENCE, 2016, 36 (02) : 290 - 301
  • [40] Dorsal anterior cingulate and ventromedial prefrontal cortex have inverse roles in both foraging and economic choice
    Amitai Shenhav
    Mark A. Straccia
    Matthew M. Botvinick
    Jonathan D. Cohen
    Cognitive, Affective, & Behavioral Neuroscience, 2016, 16 : 1127 - 1139