A working memory model improves cognitive control in agents and robots

被引:7
作者
Persiani, Michele [1 ]
Franchi, Alessio Mauro [1 ]
Gini, Giuseppina [1 ]
机构
[1] Politecn Milan, DEIB, Piazza L Da Vinci 32, Milan, Italy
来源
COGNITIVE SYSTEMS RESEARCH | 2018年 / 51卷
关键词
Cognitive agents; Working memory; Perception; Action selection;
D O I
10.1016/j.cogsys.2018.04.014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cognition entails those mental processes enabling understanding the current situation through senses, experience, and thought, and supporting the acquisition of new knowledge. A fundamental contribution in cognition is offered by the working memory, that is a small, short-term memory containing and protecting from interference goal-relevant pieces of information. Grounding our work on biological and neuroscientific studies, we modeled and implemented working memory processes in a software model, IDRA-WM, that can simultaneously act as short-term memory and actions generator, thanks to the use of a reinforcement-driven mechanism for chunk selection. Moreover our system integrates the functions of the working memory with a basic action planner. We tested the model with robot relevant tasks to assess whether the proposed solution can learn to solve a problem on the basis of a delayed reward. The experimental results indicate that IDRA-WM is able to solve even those tasks that do not provide immediate reward after an action. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 32 条
  • [1] Albus J. S., 1975, Transactions of the ASME. Series G, Journal of Dynamic Systems, Measurement and Control, V97, P220, DOI 10.1115/1.3426922
  • [2] An integrated theory of the mind
    Anderson, JR
    Bothell, D
    Byrne, MD
    Douglass, S
    Lebiere, C
    Qin, YL
    [J]. PSYCHOLOGICAL REVIEW, 2004, 111 (04) : 1036 - 1060
  • [3] [Anonymous], 2016, SOFTMAXREGRESSION
  • [4] Arcelli C., 1995, Journal of Computing and Information Technology - CIT, V3, P215
  • [5] Working Memory: Theories, Models, and Controversies
    Baddeley, Alan
    [J]. ANNUAL REVIEW OF PSYCHOLOGY, VOL 63, 2012, 63 : 1 - 29
  • [6] Bishop C., 2001, Bishop Pattern Recognition and Machine Learning
  • [7] Braver T. S, 1995, MAKING WORKING MEMOR, P551
  • [8] Braver TS, 2000, CONTROL OF COGNITIVE PROCESSES: ATTENTION AND PERFORMANCE XVIII, P713
  • [9] Deep and beautiful. The reward prediction error hypothesis of dopamine
    Colombo, Matteo
    [J]. STUDIES IN HISTORY AND PHILOSOPHY OF SCIENCE PART C-STUDIES IN HISTORY AND PHILOSOPHY OF BIOLOGICAL AND BIOMEDIAL SCIENCES, 2014, 45 : 57 - 67
  • [10] A Large-Scale Model of the Functioning Brain
    Eliasmith, Chris
    Stewart, Terrence C.
    Choo, Xuan
    Bekolay, Trevor
    DeWolf, Travis
    Tang, Charlie
    Rasmussen, Daniel
    [J]. SCIENCE, 2012, 338 (6111) : 1202 - 1205