A shared temporal window of integration across cognitive control and reinforcement learning paradigms: A correlational study

被引:1
作者
Vasta, Nicola [1 ]
Xu, Shengjie [2 ]
Verguts, Tom [2 ]
Braem, Senne [2 ]
机构
[1] Univ Trento, Dept Psychol & Cognit Sci, Corso Bettini 31, I-38068 Rovereto, TN, Italy
[2] Univ Ghent, Dept Expt Psychol, Ghent, Belgium
基金
欧洲研究理事会;
关键词
Cognitive control; Reinforcement learning; Congruency sequence effect; Time scale of control; Learning rate; Shared strategy; WORKING-MEMORY; PREFRONTAL CORTEX; ADAPTATION; MODEL; TIME; INFORMATION; PROPORTION;
D O I
10.3758/s13421-024-01626-4
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Cognitive control refers to the ability to override prepotent response tendencies to achieve goal-directed behavior. On the other hand, reinforcement learning refers to the learning of actions through feedback and reward. Although cognitive control and reinforcement learning are often viewed as opposing forces in driving behavior, recent theories have emphasized possible similarities in their underling processes. With this study, we aimed to investigate whether a similar time window of integration could be observed during the learning of control on the one hand, and the learning rate in reinforcement learning paradigms on the other. To this end, we performed a correlational analysis on a large public dataset (n = 522) including data from two reinforcement learning tasks, i.e., a probabilistic selection task and a probabilistic Wisconsin Card Sorting Task (WCST), and data from a classic conflict task (i.e., the Stroop task). Results showed expected correlations between the time scale of control indices and learning rate in the probabilistic WCST. Moreover, the learning-rate parameters of the two reinforcement learning tasks did not correlate with each other. Together, these findings suggest a reliance on a shared learning mechanism between these two traditionally distinct domains, while at the same time emphasizing that value updating processes can still be very task-specific. We speculate that updating processes in the Stroop and WCST may be more related because both tasks require task-specific updating of stimulus features (e.g., color, word meaning, pattern, shape), as opposed to stimulus identity.
引用
收藏
页码:1008 / 1021
页数:14
相关论文
共 65 条
  • [1] Beyond Trial-by-Trial Adaptation: A Quantification of the Time Scale of Cognitive Control
    Aben, Bart
    Verguts, Tom
    Van den Bussche, Eva
    [J]. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 2017, 43 (03) : 509 - 517
  • [2] Grounding Cognitive Control in Associative Learning
    Abrahamse, Elger
    Braem, Senne
    Notebaert, Wim
    Verguts, Tom
    [J]. PSYCHOLOGICAL BULLETIN, 2016, 142 (07) : 693 - 728
  • [3] Learning the value of information in an uncertain world
    Behrens, Timothy E. J.
    Woolrich, Mark W.
    Walton, Mark E.
    Rushworth, Matthew F. S.
    [J]. NATURE NEUROSCIENCE, 2007, 10 (09) : 1214 - 1221
  • [4] Motivation and Cognitive Control: From Behavior to Neural Mechanism
    Botvinick, Matthew
    Braver, Todd
    [J]. ANNUAL REVIEW OF PSYCHOLOGY, VOL 66, 2015, 66 : 83 - 113
  • [5] Conflict monitoring and cognitive control
    Botvinick, MM
    Braver, TS
    Barch, DM
    Carter, CS
    Cohen, JD
    [J]. PSYCHOLOGICAL REVIEW, 2001, 108 (03) : 624 - 652
  • [6] Measuring Adaptive Control in Conflict Tasks
    Braem, Senne
    Bugg, Julie M.
    Schmidt, James R.
    Crump, Matthew J. C.
    Weissman, Daniel H.
    Notebaert, Wim
    Egner, Tobias
    [J]. TRENDS IN COGNITIVE SCIENCES, 2019, 23 (09) : 769 - 783
  • [7] Getting a Grip on Cognitive Flexibility
    Braem, Senne
    Egner, Tobias
    [J]. CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE, 2018, 27 (06) : 470 - 476
  • [8] Conditioning task switching behavior
    Braem, Senne
    [J]. COGNITION, 2017, 166 : 272 - 276
  • [9] COMBINING SPEED AND ACCURACY IN COGNITIVE PSYCHOLOGY: IS THE INVERSE EFFICIENCY SCORE (IES) A BETTER DEPENDENT VARIABLE THAN THE MEAN REACTION TIME (RT) AND THE PERCENTAGE OF ERRORS (PE)?
    Bruyer, Raymond
    Brysbaert, Marc
    [J]. PSYCHOLOGICA BELGICA, 2011, 51 (01) : 5 - 13
  • [10] In support of a distinction between voluntary and stimulus-driven control: a review of the literature on proportion congruent effects
    Bugg, Julie M.
    Crump, Matthew J. C.
    [J]. FRONTIERS IN PSYCHOLOGY, 2012, 3