A Behavioral Decision-Making Model of Learning and Memory for Mobile Robot Triggered by Curiosity

被引:0
作者
Wang, Dongshu [1 ,2 ,3 ]
Liu, Qi [1 ]
Gao, Xulin [1 ]
Liu, Lei [4 ]
机构
[1] Zhengzhou Univ, Sch Elect & Informat Engn, Zhengzhou 450001, Henan, Peoples R China
[2] Longmen Lab, Innovat Ctr Intelligent Syst, Luoyang 471000, Henan, Peoples R China
[3] State Key Lab Intelligent Agr Power Equipment, Luoyang 471004, Peoples R China
[4] State Adm Foreign Exchange, Balance of Payments Dept, Henan Branch, Zhengzhou 450046, Henan, Peoples R China
关键词
Robots; Brain modeling; Decision making; Mobile robots; Hippocampus; Adaptation models; Encoding; Behavioral decision-making; curiosity; hippocampus; memory; mobile robot;
D O I
10.1109/TCDS.2024.3454779
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Learning and memorizing behavioral decision in the process of environmental cognition to guide future decision is an important aspect of research and application in mobile robotics. Traditional rule-based behavioral decision approaches have difficulty in adapting to complex and changing environments. The offline decision-making approaches lead to poor adaptability to dynamic environments, while behavioral decision-making based on reinforcement learning relies on data acquisition, and the learned knowledge cannot guide mobile robots to quickly adapt to new environments. To address this issue, this article proposes a brain-inspired behavioral decision model that can perform incremental learning by simulating the logical structure of memory classification in the brain, as well as the memory conversion mechanisms of hippocampus, prefrontal cortex, and anterior cingulate cortex. The model interacts with the environment through semisupervised learning and learns the current decision online, simulating the memory function of humans to enable mobile robots to adapt to changing environments. In addition, an internal reward mechanism driven by curiosity is designed, simulating the reinforcement mechanism of curiosity in human memory, encoding the memory of unfamiliar behavioral decisions for mobile robots, and consolidating the memory of frequently made behavioral decisions, improving the learning and memory capacity of mobile robots in environmental cognition. The feasibility of the proposed model is verified by physical experiments in different environments.
引用
收藏
页码:352 / 365
页数:14
相关论文
共 47 条
[1]   Pseudo-rehearsal: Achieving deep reinforcement learning without catastrophic forgetting [J].
Atkinson, Craig ;
McCane, Brendan ;
Szymanski, Lech ;
Robins, Anthony .
NEUROCOMPUTING, 2021, 428 :291-307
[2]   Neuromodulatory Systems and Their Interactions: A Review of Models, Theories, and Experiments [J].
Avery, Michael C. ;
Krichmar, Jeffrey L. .
FRONTIERS IN NEURAL CIRCUITS, 2017, 11
[3]   Eligibility traces in an autonomous soccer robot with obstacle avoidance and navigation policy [J].
Azarkasb, Seyed Omid ;
Khasteh, Seyed Hossein .
APPLIED SOFT COMPUTING, 2024, 164
[4]  
Colas C., 2020, 34 C NEUR INF PROC S
[5]   More Quickly-RRT*: Improved Quick Rapidly-exploring Random Tree Star algorithm based on optimized sampling point with better initial solution and convergence rate [J].
Cui, Xining ;
Wang, Caiqi ;
Xiong, Yi ;
Mei, Ling ;
Wu, Shiqian .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 133
[6]  
Deshpande Shripad V., 2024, Cognitive Robotics, V4, P104, DOI [10.1016/j.cogr.2024.06.001, 10.1016/j.cogr.2024.06.001]
[7]   Behavior Models of Emotion-Featured Robots: A Survey [J].
Dimitrievska, Vesna ;
Ackovska, Nevena .
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2020, 100 (3-4) :1031-1053
[8]   Curiosity-tuned experience replay for wargaming decision modeling without reward-engineering [J].
Dong, Liwei ;
Li, Ni ;
Gong, Guanghong .
SIMULATION MODELLING PRACTICE AND THEORY, 2023, 129
[9]   Reconciling Novelty and Complexity Through a Rational Analysis of Curiosity [J].
Dubey, Rachit ;
Griffiths, Thomas L. .
PSYCHOLOGICAL REVIEW, 2020, 127 (03) :455-476
[10]  
Eschmann KCJ, 2023, bioRxiv, DOI [10.1101/2023.04.21.537775, 10.1101/2023.04.21.537775, DOI 10.1101/2023.04.21.537775]