The Partial Reinforcement Extinction Effect Depends on Learning About Nonreinforced Trials Rather Than Reinforcement Rate

被引:17
作者
Harris, Justin A. [1 ]
Kwok, Dorothy W. S. [1 ]
Gottlieb, Daniel A. [2 ]
机构
[1] Univ Sydney, Sch Psychol, Sydney, NSW 2006, Australia
[2] Sweet Briar Coll, Dept Psychol, Sweet Briar, VA 24595 USA
基金
澳大利亚研究理事会;
关键词
extinction; Pavlovian conditioning; reinforcement schedules; sequential theory; rate estimation theory; FRUSTRATIVE NONREWARD; DISCRIMINATION; HISTORY; NUMBER; TIME; VIEW;
D O I
10.1037/xan0000220
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Conditioned responding extinguishes more slowly after partial (inconsistent) reinforcement than after consistent reinforcement. This Partial Reinforcement Extinction Effect (PREE) is usually attributed to learning about nonreinforcement during the partial schedule. An alternative explanation attributes it to any difference in the rate of reinforcement, arguing that animals can detect the change to nonreinforcement more quickly after a denser schedule than a leaner schedule. Experiments 1a and 1b compared extinction of magazine responding to a conditioned stimulus (CS) reinforced with 1 food pellet per trial and a CS reinforced with 2 pellets per trial. Despite the difference in reinforcement rate, there was no reliable difference in extinction. Both experiments did demonstrate the conventional PREE comparing a partial CS (50% reinforced) with a consistent CS. Experiments 2 and 3 tested whether the PREE depends specifically on learning about nonreinforced trials during partial reinforcement. Rats were trained with 2 CS configurations, A and AX. One was partially reinforced, the other consistently reinforced. When AX was partial and A consistent, responding to AX extinguished more slowly than to A. When AX was consistent and A was partial, there was no difference in their extinction. Therefore, pairing X with partial reinforcement allowed rats to show a PREE to AX that did not generalize to A. Pairing A with partial reinforcement meant that rats showed a PREE to A that generalized to AX. Thus, the PREE depends on learning about nonreinforced trials during partial reinforcement and is not because of any difference in per-trial probability of reinforcement.
引用
收藏
页码:485 / 501
页数:17
相关论文
共 39 条
[2]   THE ROLE OF FRUSTRATIVE NONREWARD IN NONCONTINUOUS REWARD SITUATIONS [J].
AMSEL, A .
PSYCHOLOGICAL BULLETIN, 1958, 55 (02) :102-119
[3]   Delay of Reinforcement Versus Rate of Reinforcement in Pavlovian Conditioning [J].
Austen, Joseph M. ;
Sanderson, David J. .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-ANIMAL LEARNING AND COGNITION, 2019, 45 (02) :203-221
[4]   PARTIAL-REINFORCEMENT EXTINCTION EFFECTFOLLOWING DIFFERENT AMOUNTS OF TRAINING [J].
BACON, WE .
JOURNAL OF COMPARATIVE AND PHYSIOLOGICAL PSYCHOLOGY, 1962, 55 (06) :998-&
[5]   Temporal maps and informativeness in associative learning [J].
Balsam, Peter D. ;
Gallistel, C. Randy .
TRENDS IN NEUROSCIENCES, 2009, 32 (02) :73-78
[6]   Separation of time-based and trial-based accounts of the partial reinforcement extinction effect [J].
Bouton, Mark E. ;
Woods, Amanda M. ;
Todd, Travis P. .
BEHAVIOURAL PROCESSES, 2014, 101 :23-31
[7]   Asymmetrical Generalization of Conditioning and Extinction From Compound to Element and Element to Compound [J].
Bouton, Mark E. ;
Doyle-Burr, Caleb ;
Vurbic, Drina .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-ANIMAL BEHAVIOR PROCESSES, 2012, 38 (04) :381-393
[8]   A componential view of configural cues in generalization and discrimination in Pavlovian conditioning [J].
Brandon, SE ;
Vogel, EH ;
Wagner, AR .
BEHAVIOURAL BRAIN RESEARCH, 2000, 110 (1-2) :67-72
[9]   PARTIAL REINFORCEMENT - A HYPOTHESIS OF SEQUENTIAL EFFECTS [J].
CAPALDI, EJ .
PSYCHOLOGICAL REVIEW, 1966, 73 (05) :459-&
[10]   THE SEQUENTIAL VIEW - FROM RAPIDLY FADING STIMULUS TRACES TO THE ORGANIZATION OF MEMORY AND THE ABSTRACT CONCEPT OF NUMBER [J].
CAPALDI, EJ .
PSYCHONOMIC BULLETIN & REVIEW, 1994, 1 (02) :156-181