Autoshaped impulsivity: Some explorations with a neural network model

被引:1
作者
Aguayo-Mendoza, Miguel [1 ]
Buritica, Jonathan [1 ]
Burgos, Jose E. [1 ]
机构
[1] Univ Guadalajara, Ctr Estudios & Invest Comportamiento, Guadalajara, Mexico
关键词
Artificial neural networks; Impulsivity; Pavlovian contingencies; Temporal discounting; Computational learning models; Autoshaped; THEORETICAL NOTE; REINFORCEMENT; CONTEXT; TRACE; ACQUISITION; INHIBITION; RETRIEVAL; SOMETIMES; INTERVAL; PIGEONS;
D O I
10.1016/j.beproc.2024.105040
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
This study evaluated the effect of delay and magnitude of reinforcement in Pavlovian contingencies, extending the understanding of the phenomenon of autoshaped impulsivity as described in Alcal<acute accent>a's thesis (2017) and Burgos and Garcia-Leal (2015). The effects of adding a trace interval were analyzed on the maintained responses of impulsive choice, seen as the preference of a small and immediate reinforcer over a larger and delayed one, and the role of the contextual unit, as well as the inhibitory units according to the Diffuse Discrepancy Model. In the Simulation, the model with inhibitory units was used, trained in two signals with different delays and reinforcement magnitudes, and subsequently presented concurrently in choice tasks without reinforcement nor learning, using an ABA within-subject design. In general, the DD model successfully simulated the phenomenon of autoshaped impulsivity, consistent with studies from Alcal<acute accent>a's thesis (2017), Burgos and Garcia-Leal (2015), and Picker and Poling (1982). It also predicted the elimination of this effect (autoshaped impulsivity) after introducing a trace interval. The observed results and their implications are discussed, as well as possible future studies with animals and humans.
引用
收藏
页数:10
相关论文
共 59 条
[1]   PREFERENCE REVERSAL AND DELAYED REINFORCEMENT [J].
AINSLIE, G ;
HERRNSTEIN, RJ .
ANIMAL LEARNING & BEHAVIOR, 1981, 9 (04) :476-482
[2]   IMPULSE CONTROL IN PIGEONS [J].
AINSLIE, GW .
JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR, 1974, 21 (03) :485-489
[3]  
Alcala J.E., 2017, Master's thesis
[4]   PRECONDITIONING CS EXPOSURE - VARIATION IN PLACE OF CONDITIONING AND OF PRESENTATION [J].
ANDERSON, DC ;
OFARRELL, T ;
FORMICA, R ;
CAPONIGR.V .
PSYCHONOMIC SCIENCE, 1969, 15 (01) :54-&
[5]  
Arevian A.C, 2007, BMC Neurosci., V8, DOI [10.1186/1471-2202-8-S2-P126, DOI 10.1186/1471-2202-8-S2-P126]
[6]   Activity-dependent gating of lateral inhibition in the mouse olfactory bulb [J].
Arevian, Armen C. ;
Kapoor, Vikrant ;
Urban, Nathaniel N. .
NATURE NEUROSCIENCE, 2008, 11 (01) :80-87
[7]   The role of the hippocampus in trace conditioning: Temporal discontinuity or task difficulty? [J].
Beylin, AV ;
Gandhi, CC ;
Wood, GE ;
Talk, AC ;
Matzel, LD ;
Shors, TJ .
NEUROBIOLOGY OF LEARNING AND MEMORY, 2001, 76 (03) :447-461
[8]   AUTO-SHAPING OF PIGEONS KEY-PECK [J].
BROWN, PL ;
JENKINS, HM .
JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR, 1968, 11 (01) :1-&
[9]  
Brownlee J., 2018, Statistical methods for machine learning: Discover how to transform data into knowledge with Python
[10]  
Burgos J. E., 1997, NEURAL NETWORK MODEL, V121, P58, DOI [10.1016/S0166-4115(97)80090-8, DOI 10.1016/S0166-4115(97)80090-8]