Expecting the unexpected: a review of learning under uncertainty across development

被引:9
作者
Topel, Selin [1 ,2 ]
Ma, Ili [1 ,2 ]
Sleutels, Jan [1 ,3 ]
van Steenbergen, Henk [1 ,2 ]
de Bruijn, Ellen R. A. [1 ,2 ]
van Duijvenvoorde, Anna C. K. [1 ,2 ]
机构
[1] Leiden Univ, Inst Psychol, Wassenaarseweg 52, NL-2333 AK Leiden, Netherlands
[2] Leiden Inst Brain & Cognit, Leiden, Netherlands
[3] Leiden Univ, Inst Philosophy, Leiden, Netherlands
基金
美国国家科学基金会;
关键词
Adolescence; Uncertainty; Volatility; Stochasticity; Learning; Decision-making; DECISION-MAKING; SOCIAL REORIENTATION; PREDICTION ERROR; ADOLESCENT BRAIN; PEER INFLUENCE; REWARD; BEHAVIOR; ANXIETY; NOISE; RISK;
D O I
10.3758/s13415-023-01098-0
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Many of our decisions take place under uncertainty. To successfully navigate the environment, individuals need to estimate the degree of uncertainty and adapt their behaviors accordingly by learning from experiences. However, uncertainty is a broad construct and distinct types of uncertainty may differentially influence our learning. We provide a semi-systematic review to illustrate cognitive and neurobiological processes involved in learning under two types of uncertainty: learning in environments with stochastic outcomes, and with volatile outcomes. We specifically reviewed studies (N = 26 studies) that included an adolescent population, because adolescence is a period in life characterized by heightened exploration and learning, as well as heightened uncertainty due to experiencing many new, often social, environments. Until now, reviews have not comprehensively compared learning under distinct types of uncertainties in this age range. Our main findings show that although the overall developmental patterns were mixed, most studies indicate that learning from stochastic outcomes, as indicated by increased accuracy in performance, improved with age. We also found that adolescents tended to have an advantage compared with adults and children when learning from volatile outcomes. We discuss potential mechanisms explaining these age-related differences and conclude by outlining future research directions.
引用
收藏
页码:718 / 738
页数:21
相关论文
共 107 条
[21]   The Age of Onset of Anxiety Disorders: A Meta-analysis [J].
de Lijster, Jasmijn M. ;
Dierckx, Bram ;
Utens, Elisabeth M. W. J. ;
Verhulst, Frank C. ;
Zieldorff, Carola ;
Dieleman, Gwen C. ;
Legerstee, Jeroen S. .
CANADIAN JOURNAL OF PSYCHIATRY-REVUE CANADIENNE DE PSYCHIATRIE, 2017, 62 (04) :237-246
[22]   Experiential reward learning outweighs instruction prior to adulthood [J].
Decker, Johannes H. ;
Lourenco, Frederico S. ;
Doll, Bradley B. ;
Hartley, Catherine A. .
COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE, 2015, 15 (02) :310-320
[23]   Why most people disapprove of me: Experience sampling in impression formation [J].
Denrell, J .
PSYCHOLOGICAL REVIEW, 2005, 112 (04) :951-978
[24]   Reinforcement learning and Bayesian inference provide complementary models for the of adolescents in stochastic reversal [J].
Eckstein, Maria K. ;
Master, Sarah L. ;
Dahl, Ronald E. ;
Wilbrecht, Linda ;
Collins, Anne G. E. .
DEVELOPMENTAL COGNITIVE NEUROSCIENCE, 2022, 55
[25]   What do reinforcement learning models measure? Interpreting model parameters in cognition and neuroscience [J].
Eckstein, Maria K. ;
Wilbrecht, Linda ;
Collins, Anne Ge .
CURRENT OPINION IN BEHAVIORAL SCIENCES, 2021, 41 :128-137
[26]   White Matter Hyperintensities (WMH) and clinical outcome after vestibular neuritis [J].
Fan, Huimin ;
Feng, Jing ;
Wills, Melissa ;
Wang, Liying ;
Chen, Xiaomeng ;
Geng, Xiaokun ;
Ding, Yuchuan .
NEUROLOGICAL RESEARCH, 2022, 44 (07) :622-629
[27]   Computation noise in human learning and decision-making: origin, impact, function [J].
Findling, Charles ;
Wyart, Valentin .
CURRENT OPINION IN BEHAVIORAL SCIENCES, 2021, 38 :124-132
[28]   Computational noise in reward-guided learning drives behavioral variability in volatile environments [J].
Findling, Charles ;
Skvortsova, Vasilisa ;
Dromnelle, Remi ;
Palminteri, Stefano ;
Wyart, Valentin .
NATURE NEUROSCIENCE, 2019, 22 (12) :2066-+
[29]   By carrot or by stick: Cognitive reinforcement learning in Parkinsonism [J].
Frank, MJ ;
Seeberger, LC ;
O'Reilly, RC .
SCIENCE, 2004, 306 (5703) :1940-1943
[30]   Impaired adaptation of learning to contingency volatility in internalizing psychopathology [J].
Gagne, Christopher ;
Zika, Ondrej ;
Dayan, Peter ;
Bishop, Sonia J. .
ELIFE, 2020, 9