The Partial Reinforcement Extinction Effect: The Proportion of Trials Reinforced During Conditioning Predicts the Number of Trials to Extinction

被引:31
作者
Chan, C. K. Jonas [1 ]
Harris, Justin A. [1 ]
机构
[1] Univ Sydney, Sch Psychol, Griffith Taylor Bldg, Sydney, NSW 2006, Australia
基金
澳大利亚研究理事会;
关键词
partial reinforcement extinction effect; timing models; associative models; trial-wise models; Weibull function; FRUSTRATIVE NONREWARD; BEHAVIORAL MOMENTUM; TIME; RESISTANCE; SUBJECT;
D O I
10.1037/xan0000190
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Four experiments compared the extinction of responding to a continuously reinforced (CRf) conditioned stimulus (conditional stimulus [CS]) consistently reinforced on every trial, with extinction of responding to a partially reinforced (PRf) CS that had been inconsistently reinforced. To equate the acquisition of responding between the two CSs, the average duration of the CRf CS was extended so that it scheduled the same overall rate of reinforcement per unit time as the PRf CS. Experiment 1 used a within-subjects design to compare the rates of extinction for a 10-s PRf CS reinforced on 33% of trials versus a 30-s CRf CS. Experiment 2 made the same comparison but using a between-subjects design. Experiment 3 compared extinction in a group trained with a 10-s PRf CS reinforced on 20% of trials and a group trained with a 50-s CRf CS. Experiment 4 compared the rates of extinction following two partial reinforcement schedules: a 10-s PRf CS reinforced on 33% of trial versus a 20-s CRf CS reinforced on 66% of trials. In each experiment, responding took longer to extinguish for the CS that scheduled a lower per-trial probability of reinforcement. Modeling of individual extinction curves using Weibull functions indicated that the latency to initiate extinction was directly related to the per-trial probability of reinforcement learned during acquisition. For example, compared with training with a CRf CS, rats reinforced on 33% of trials took approximately 3 times as many trials to initiate extinction, and rats reinforced on 20% of trials took 5 times as many trials to initiate extinction. These results provide support for trial-based accounts of extinction (e.g., Capaldi & Deutsch, 1967), whereby rats learn about the expected number of trials per reinforcer, and extinction depends on the number of expected reinforcers that have been omitted rather than on the number of extinction trials per se.
引用
收藏
页码:43 / 58
页数:16
相关论文
共 32 条
[1]  
AMSEL A, 1966, PSYCHOL MONOGR, V80, P1
[3]   THE ROLE OF FRUSTRATIVE NONREWARD IN NONCONTINUOUS REWARD SITUATIONS [J].
AMSEL, A .
PSYCHOLOGICAL BULLETIN, 1958, 55 (02) :102-119
[4]   Separation of time-based and trial-based accounts of the partial reinforcement extinction effect [J].
Bouton, Mark E. ;
Woods, Amanda M. ;
Todd, Travis P. .
BEHAVIOURAL PROCESSES, 2014, 101 :23-31
[5]   Contextual control of appetitive conditioning: Influence of a contextual stimulus generated by a partial reinforcement procedure [J].
Bouton, ME ;
Sunsay, C .
QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY SECTION B-COMPARATIVE AND PHYSIOLOGICAL PSYCHOLOGY, 2001, 54 (02) :109-125
[6]  
Capaldi E. J., 1971, P111
[7]  
Capaldi E. J., 1967, PSYCHON SCI, V9, P171, DOI 10.3758/BF03330814
[8]   PARTIAL REINFORCEMENT - A HYPOTHESIS OF SEQUENTIAL EFFECTS [J].
CAPALDI, EJ .
PSYCHOLOGICAL REVIEW, 1966, 73 (05) :459-&
[9]   THE SEQUENTIAL VIEW - FROM RAPIDLY FADING STIMULUS TRACES TO THE ORGANIZATION OF MEMORY AND THE ABSTRACT CONCEPT OF NUMBER [J].
CAPALDI, EJ .
PSYCHONOMIC BULLETIN & REVIEW, 1994, 1 (02) :156-181
[10]   Extinction of Pavlovian conditioning: The influence of trial number and reinforcement history [J].
Chan, C. K. J. ;
Harris, Justin A. .
BEHAVIOURAL PROCESSES, 2017, 141 :19-25