Hierarchical Error Representation: A Computational Model of Anterior Cingulate and Dorsolateral Prefrontal Cortex

被引:75
作者
Alexander, William H. [1 ,2 ]
Brown, Joshua W. [1 ]
机构
[1] Indiana Univ, Dept Psychol & Brain Sci, Bloomington, IN 47405 USA
[2] Univ Ghent, Dept Expt Psychol, B-9000 Ghent, Belgium
关键词
WORKING-MEMORY; COGNITIVE CONTROL; FRONTAL-CORTEX; FUNCTIONAL-ORGANIZATION; INTEGRATIVE THEORY; NEURAL MECHANISMS; DOPAMINE NEURONS; DECISION-MAKING; TERM-MEMORY; ATTENTION;
D O I
10.1162/NECO_a_00779
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anterior cingulate and dorsolateral prefrontal cortex (ACC and dlPFC, respectively) are core components of the cognitive control network. Activation of these regions is routinely observed in tasks that involve monitoring the external environment and maintaining information in order to generate appropriate responses. Despite the ubiquity of studies reporting coactivation of these two regions, a consensus on how they interact to support cognitive control has yet to emerge. In this letter, we present a new hypothesis and computational model of ACC and dlPFC. The error representation hypothesis states that multidimensional error signals generated by ACC in response to surprising outcomes are used to train representations of expected error in dlPFC, which are then associated with relevant task stimuli. Error representations maintained in dlPFC are in turn used to modulate predictive activity in ACC in order to generate better estimates of the likely outcomes of actions. We formalize the error representation hypothesis in a new computational model based on our previous model of ACC. The hierarchical error representation (HER) model of ACC/dlPFC suggests a mechanism by which hierarchically organized layers within ACC and dlPFC interact in order to solve sophisticated cognitive tasks. In a series of simulations, we demonstrate the ability of the HER model to autonomously learn to perform structured tasks in a manner comparable to human performance, and we show that the HER model outperforms current deep learning networks by an order of magnitude.
引用
收藏
页码:2354 / 2410
页数:57
相关论文
共 50 条
  • [41] Frontal midline theta rhythms reflect alternative activation of prefrontal cortex and anterior cingulate cortex in humans
    Asada, H
    Fukuda, Y
    Tsunoda, S
    Yamaguchi, M
    Tonoike, M
    NEUROSCIENCE LETTERS, 1999, 274 (01) : 29 - 32
  • [42] Medial prefrontal cortex-dorsal anterior cingulate cortex connectivity during behavior selection without an objective correct answer
    Nakao, Takashi
    Osumi, Takahiro
    Ohira, Hideki
    Kasuya, Yukinori
    Shinoda, Jun
    Yamada, Jitsuhiro
    Northoff, Georg
    NEUROSCIENCE LETTERS, 2010, 482 (03) : 220 - 224
  • [43] Modulation of feedback related activity in the rostral anterior cingulate cortex during trial and error exploration
    Amiez, Celine
    Sallet, Jerome
    Procyk, Emmanuel
    Petrides, Michael
    NEUROIMAGE, 2012, 63 (03) : 1078 - 1090
  • [44] Impaired Error Awareness and Anterior Cingulate Cortex Hypoactivity in Chronic Cannabis Users
    Robert Hester
    Liam Nestor
    Hugh Garavan
    Neuropsychopharmacology, 2009, 34 : 2450 - 2458
  • [45] Neuronal Representation of Locomotion During Motivated Behavior in the Mouse Anterior Cingulate Cortex
    Sachuriga
    Nishimaru, Hiroshi
    Takamura, Yusaku
    Matsumoto, Jumpei
    Pereira de Araujo, Mariana Ferreira
    Ono, Taketoshi
    Nishijo, Hisao
    FRONTIERS IN SYSTEMS NEUROSCIENCE, 2021, 15
  • [46] GABA concentrations in the anterior cingulate and dorsolateral prefrontal cortices: Associations with chronic cigarette smoking, neurocognition, and decision making
    Durazzo, Timothy C.
    Meyerhoff, Dieter J.
    ADDICTION BIOLOGY, 2021, 26 (03)
  • [47] The role of mid-dorsolateral prefrontal cortex in working memory: a connectionist model
    Wendelken, C
    NEUROCOMPUTING, 2002, 44 : 1009 - 1016
  • [48] Interneuron-specific gamma synchronization indexes cue uncertainty and prediction errors in lateral prefrontal and anterior cingulate cortex
    Boroujeni, Kianoush Banaie
    Tiesinga, Paul
    Womelsdorf, Thilo
    ELIFE, 2021, 10
  • [49] Hierarchical Control Over Effortful Behavior by Rodent Medial Frontal Cortex: A Computational Model
    Holroyd, Clay B.
    McClure, Samuel M.
    PSYCHOLOGICAL REVIEW, 2015, 122 (01) : 54 - 83
  • [50] Network Profiles of the Dorsal Anterior Cingulate and Dorsal Prefrontal Cortex in Schizophrenia During Hippocampal-Based Associative Memory
    Woodcock, Eric A.
    Wadehra, Sunali
    Diwadkar, Vaibhav A.
    FRONTIERS IN SYSTEMS NEUROSCIENCE, 2016, 10