An Iowa Gambling Task-based experiment applied to robots: A Study on Long-term Decision Making

被引:1
作者
Berto, Leticia M. [1 ]
Costa, Paula D. P. [2 ]
Simoes, Alexandre S. [3 ]
Gudwin, Ricardo R. [2 ]
Colombini, Esther L. [1 ]
机构
[1] Lab Robot & Cognit Syst UNICAMP, Campinas, Brazil
[2] DCA FEEC UNICAMP, Campinas, Brazil
[3] Dept Control & Automat Engn UNESP, Sorocaba, Brazil
来源
IEEE INTERNATIONAL CONFERENCE ON DEVELOPMENT AND LEARNING, ICDL 2021 | 2021年
关键词
Models of emotions and internal states; Intrinsic Motivation; Exploration and Play; Action selection and planning; PERFORMANCE;
D O I
10.1109/ICDL49984.2021.9515632
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Designing a robot's decision-making process is challenging because it is still not completely understood even in humans. However, it is a fundamental process in the search for autonomous agents. When making decisions, we consider the short and long-term consequences of our actions, but some impairments prevent some people from seeing in the long run. Using as an inspiration an experiment carried out with humans in which decision-making is evaluated under the uncertainty of premises and results, rewards, and punishments, we created an equivalent robotics experiment. To model our agent's state, we use a set of drives. Our agent's goal is to reduce the distance between its homeostasis state and its needs. We trained a simulated robot with reinforcement learning, showing that long-term assessment agents can survive longer while satisfying other needs.
引用
收藏
页数:6
相关论文
共 22 条
[1]   INSENSITIVITY TO FUTURE CONSEQUENCES FOLLOWING DAMAGE TO HUMAN PREFRONTAL CORTEX [J].
BECHARA, A ;
DAMASIO, AR ;
DAMASIO, H ;
ANDERSON, SW .
COGNITION, 1994, 50 (1-3) :7-15
[2]  
Berto L. M., 2020, Exploring cognitive functions in robotics
[3]   Learning over the Attentional Space with Mobile Robots [J].
Berto, Leticia M. ;
Rossi, Leonardo de L. ;
Rohmer, Eric ;
Costa, Paula D. P. ;
Simoes, Alexandre S. ;
Gudwin, Ricardo R. ;
Colombini, Esther L. .
10TH IEEE INTERNATIONAL CONFERENCE ON DEVELOPMENT AND LEARNING AND EPIGENETIC ROBOTICS (ICDL-EPIROB 2020), 2020,
[4]   Anorexia, bulimia, and obesity: Shared decision making deficits on the Iowa Gambling Task (IGT) [J].
Brogan, Amy ;
Hevey, David ;
Pignatti, Riccardo .
JOURNAL OF THE INTERNATIONAL NEUROPSYCHOLOGICAL SOCIETY, 2010, 16 (04) :711-715
[5]   A ROBUST LAYERED CONTROL-SYSTEM FOR A MOBILE ROBOT [J].
BROOKS, RA .
IEEE JOURNAL OF ROBOTICS AND AUTOMATION, 1986, 2 (01) :14-23
[6]  
Cherry K., 2020, Drive-reduction theory and human behavior
[7]   The Multipurpose Enhanced Cognitive Architecture (MECA) [J].
Gudwin, Ricardo ;
Paraense, Andre ;
de Paula, Suelen M. ;
Froes, Eduardo ;
Gibaut, Wandemberg ;
Castro, Elisa ;
Figueiredo, Vera ;
Raizer, Klaus .
BIOLOGICALLY INSPIRED COGNITIVE ARCHITECTURES, 2017, 22 :20-34
[8]   Adolescents' performance on the Iowa gambling task: Implications for the development of decision making and ventromedial prefrontal cortex [J].
Hooper, CJ ;
Luciana, M ;
Conklin, HM ;
Yarger, RS .
DEVELOPMENTAL PSYCHOLOGY, 2004, 40 (06) :1148-1158
[9]  
Hull C.L., 1943, PRINCIPLES BEHAV INT, P422
[10]  
Mcleod S., 2020, SIMPLY PSYCHOL