A Primer on Foraging and the Explore/Exploit Trade-Off for Psychiatry Research

被引:121
作者
Addicott, M. A. [1 ]
Pearson, J. M. [2 ]
Sweitzer, M. M. [1 ]
Barack, D. L. [3 ]
Platt, M. L. [4 ,5 ,6 ]
机构
[1] Duke Univ, Dept Psychiat & Behav Sci, Durham, NC USA
[2] Duke Univ, Ctr Cognit Neurosci, Durham, NC USA
[3] Columbia Univ, Dept Philosophy & Neurosci, New York, NY USA
[4] Univ Penn, Dept Psychol, 3815 Walnut St, Philadelphia, PA 19104 USA
[5] Univ Penn, Dept Neurosci, Philadelphia, PA 19104 USA
[6] Univ Penn, Dept Mkt, Philadelphia, PA 19104 USA
关键词
NUCLEUS-ACCUMBENS DOPAMINE; DECISION-MAKING; FRONTOPOLAR CORTEX; NEURAL MECHANISMS; BRAIN ACTIVATION; EXPLORATION; EXPLOITATION; UNCERTAINTY; BEHAVIOR; IMPULSIVITY;
D O I
10.1038/npp.2017.108
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Foraging is a fundamental behavior, and many types of animals appear to have solved foraging problems using a shared set of mechanisms. Perhaps the most common foraging problem is the choice between exploiting a familiar option for a known reward and exploring unfamiliar options for unknown rewards-the so-called explore/exploit trade-off. This trade-off has been studied extensively in behavioral ecology and computational neuroscience, but is relatively new to the field of psychiatry. Explore/exploit paradigms can offer psychiatry research a new approach to studying motivation, outcome valuation, and effort-related processes, which are disrupted in many mental and emotional disorders. In addition, the explore/exploit trade-off encompasses elements of risk-taking and impulsivity-common behaviors in psychiatric disorders-and provides a novel framework for understanding these behaviors within an ecological context. Here we explain relevant concepts and some common paradigms used to measure explore/exploit decisions in the laboratory, review clinically relevant research on the neurobiology and neuroanatomy of explore/exploit decision making, and discuss how computational psychiatry can benefit from foraging theory.
引用
收藏
页码:1931 / 1939
页数:9
相关论文
共 77 条
[51]   Foraging across the life span: is there a reduction in exploration with aging? [J].
Mata, Rui ;
Wilke, Andreas ;
Czienskowski, Uwe .
FRONTIERS IN NEUROSCIENCE, 2013, 7
[52]   Biases in the Explore-Exploit Tradeoff in Addictions: The Role of Avoidance of Uncertainty [J].
Morris, Laurel S. ;
Baek, Kwangyeol ;
Kundu, Prantik ;
Harrison, Neil A. ;
Frank, Michael J. ;
Voon, Valerie .
NEUROPSYCHOPHARMACOLOGY, 2016, 41 (04) :940-948
[53]   A Role for Dopamine in Temporal Decision Making and Reward Maximization in Parkinsonism [J].
Moustafa, Ahmed A. ;
Cohen, Michael X. ;
Sherman, Scott J. ;
Frank, Michael J. .
JOURNAL OF NEUROSCIENCE, 2008, 28 (47) :12294-12304
[54]   Nicotinic receptors in the ventral tegmental area promote uncertainty-seeking [J].
Naude, Jeremie ;
Tolu, Stefania ;
Dongelmans, Malou ;
Torquet, Nicolas ;
Valverde, Sebastien ;
Rodriguez, Guillaume ;
Pons, Stephanie ;
Maskos, Uwe ;
Mourot, Alexandre ;
Marti, Fabio ;
Faure, Philippe .
NATURE NEUROSCIENCE, 2016, 19 (03) :471-+
[55]   AN EVOLUTIONARY PERSPECTIVE ON PSYCHIATRY [J].
NESSE, RM .
COMPREHENSIVE PSYCHIATRY, 1984, 25 (06) :575-580
[56]  
NIH, 2016, DEV DEF RDOC DOM CON
[57]   Decision Making: The Neuroethological Turn [J].
Pearson, John M. ;
Watson, Karli K. ;
Platt, Michael L. .
NEURON, 2014, 82 (05) :950-965
[58]   Posterior cingulate cortex: adapting behavior to a changing world [J].
Pearson, John M. ;
Heilbronner, Sarah R. ;
Barack, David L. ;
Hayden, Benjamin Y. ;
Platt, Michael L. .
TRENDS IN COGNITIVE SCIENCES, 2011, 15 (04) :143-151
[59]   Neurons in Posterior Cingulate Cortex Signal Exploratory Decisions in a Dynamic Multioption Choice Task [J].
Pearson, John M. ;
Hayden, Benjamin Y. ;
Raghavachari, Sridhar ;
Platt, Michael L. .
CURRENT BIOLOGY, 2009, 19 (18) :1532-1537
[60]   Pigeon and human performance in a multi-armed bandit task in response to changes in variable interval schedules [J].
Racey, Deborah ;
Young, Michael E. ;
Garlick, Dennis ;
Pham, Jennifer Ngoc-Minh ;
Blaisdell, Aaron P. .
LEARNING & BEHAVIOR, 2011, 39 (03) :245-258