Approach-avoidance reinforcement learning as a translational and computational model of anxiety-related avoidance

被引:7
作者
Yamamori, Yumeya [1 ]
Robinson, Oliver J. [1 ,2 ]
Roiser, Jonathan P. [1 ]
机构
[1] UCL, Inst Cognit Neurosci, London, England
[2] UCL, Res Dept Clin Educ & Hlth Psychol, London, England
基金
英国医学研究理事会; 英国惠康基金;
关键词
anxiety; computational modelling; translational; approach-avoidance conflict; reinforcement learning; Human; EXPERIENTIAL AVOIDANCE; DECISION-MAKING; ANIMAL-MODELS; REWARD; CONFLICT; DEPRESSION; PUNISHMENT; DISORDERS;
D O I
10.7554/eLife.87720
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Although avoidance is a prevalent feature of anxiety-related psychopathology, differences in the measurement of avoidance between humans and non-human animals hinder our progress in its theoretical understanding and treatment. To address this, we developed a novel translational measure of anxiety-related avoidance in the form of an approach-avoidance reinforcement learning task, by adapting a paradigm from the non-human animal literature to study the same cognitive processes in human participants. We used computational modelling to probe the putative cognitive mechanisms underlying approach-avoidance behaviour in this task and investigated how they relate to subjective task-induced anxiety. In a large online study (n = 372), participants who experienced greater task-induced anxiety avoided choices associated with punishment, even when this resulted in lower overall reward. Computational modelling revealed that this effect was explained by greater individual sensitivities to punishment relative to rewards. We replicated these findings in an independent sample (n = 627) and we also found fair-to-excellent reliability of measures of task performance in a sub-sample retested 1 week later (n = 57). Our findings demonstrate the potential of approach-avoidance reinforcement learning tasks as translational and computational models of anxiety-related avoidance. Future studies should assess the predictive validity of this approach in clinical samples and experimental manipulations of anxiety.
引用
收藏
页数:39
相关论文
共 81 条
[1]   Emotion-regulation strategies across psychopathology: A meta-analytic review [J].
Aldao, Amelia ;
Nolen-Hoeksema, Susan ;
Schweizer, Susanne .
CLINICAL PSYCHOLOGY REVIEW, 2010, 30 (02) :217-237
[2]   A reverse translational approach to quantify approach-avoidance conflict in humans [J].
Aupperle, Robin L. ;
Sullivan, Sarah ;
Melrose, Andrew J. ;
Paulus, Martin P. ;
Stein, Murray B. .
BEHAVIOURAL BRAIN RESEARCH, 2011, 225 (02) :455-463
[3]  
Aupperle Robin L, 2010, Dialogues Clin Neurosci, V12, P517
[4]   Altered learning under uncertainty in unmedicated mood and anxiety disorders [J].
Aylward, Jessica ;
Valton, Vincent ;
Ahn, Woo-Young ;
Bond, Rebecca L. ;
Dayan, Peter ;
Roiser, Jonathan P. ;
Robinson, Oliver J. .
NATURE HUMAN BEHAVIOUR, 2019, 3 (10) :1116-1123
[5]   Cross-species anxiety tests in psychiatry: pitfalls and promises [J].
Bach, Dominik R. .
MOLECULAR PSYCHIATRY, 2022, 27 (01) :154-163
[6]   An information processing model of anxiety: Automatic and strategic processes [J].
Beck, AT ;
Clark, DA .
BEHAVIOUR RESEARCH AND THERAPY, 1997, 35 (01) :49-58
[7]   An elevated plus-maze in mixed reality for studying human anxiety-related behavior [J].
Biedermann, Sarah V. ;
Biedermann, Daniel G. ;
Wenzlaff, Frederike ;
Kurjak, Tim ;
Nouri, Sawis ;
Auer, Matthias K. ;
Wiedemann, Klaus ;
Briken, Peer ;
Haaker, Jan ;
Lonsdorf, Tina B. ;
Fuss, Johannes .
BMC BIOLOGY, 2017, 15
[8]   Neurocognitive mechanisms of anxiety: an integrative account [J].
Bishop, Sonia J. .
TRENDS IN COGNITIVE SCIENCES, 2007, 11 (07) :307-316
[9]   Anxiety, Depression, and Decision Making: A Computational Perspective [J].
Bishop, Sonia J. ;
Gagne, Christopher .
ANNUAL REVIEW OF NEUROSCIENCE, VOL 41, 2018, 41 :371-388
[10]  
Carlisi Christina O, 2018, Brain Neurosci Adv, V2, p2398212818774223, DOI [10.1177/2398212818774223, 10.1177/2398212818774223]