The Cyber Rodent project: Exploration of adaptive mechanisms for self-preservation and self-reproduction

被引:45
作者
Doya, K [1 ]
Uchibe, E [1 ]
机构
[1] Okinawa Inst Sci & Technol, Initial Res Project, Okinawa 9042234, Japan
关键词
reinforcement learning; reward function; self-preservation and self-reproduction; learning and evolution;
D O I
10.1177/105971230501300206
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The aim of the Cyber Rodent project is to understand the origins of our reward and affective systems by building artificial agents that share the same intrinsic constraints as natural agents: Self-preserva tion and self-reproduction. A Cyber Rodent is a robot that can search for and recharge from battery packs on the floor and copy its programs to a nearby agent through its infrared communication port. This article reviews our research topics so far, including (1) evolution of neural controllers, (2) learning of foraging and mating behaviors, (3) evolution of learning architectures and meta-parameters, (4) simultaneous learning of multiple agents in a body, and (5) learning and evolution in a self-sustained colony. We discuss our future directions and expected contributions.
引用
收藏
页码:149 / 160
页数:12
相关论文
共 30 条
[1]  
BIRK A, 1998, LECT NOTES ARTIFICIA, V1545
[2]   Evolution of neural architecture fitting environmental dynamics [J].
Capi, G ;
Doya, K .
ADAPTIVE BEHAVIOR, 2005, 13 (01) :53-66
[3]  
CAPI G, 2003, DYNAMIC SYSTEMS APPR, V6, P311
[4]  
CAPI G, 2002, P INT S HUM ART INT, P231
[5]  
CAPI G, 2003, P C EV COMP, V1, P514
[6]   Hierarchical reinforcement learning with the MAXQ value function decomposition [J].
Dietterich, TG .
JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2000, 13 :227-303
[7]  
Doncieux S, 2004, P 4 INT ICSC S ENG I
[8]   Complementary roles of basal ganglia and cerebellum in learning and motor control [J].
Doya, K .
CURRENT OPINION IN NEUROBIOLOGY, 2000, 10 (06) :732-739
[9]   Metalearning and neuromodulation [J].
Doya, K .
NEURAL NETWORKS, 2002, 15 (4-6) :495-506
[10]  
DOYA K, 2003, ATR UP DATE, V5, P12