Operant conditioning

被引:223
作者
Staddon, JER [1 ]
Cerutti, DT [1 ]
机构
[1] Duke Univ, Dept Psychol & Brain Sci, Durham, NC 27708 USA
关键词
interval timing; choice; concurrent schedules; matching law; self-control;
D O I
10.1146/annurev.psych.54.101601.145124
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Operant behavior is behavior "controlled" by its consequences. In practice, operant conditioning is the study of reversible behavior maintained by reinforcement schedules. We review empirical studies and theoretical approaches to two large classes of operant behavior: interval timing and choice. We discuss cognitive versus behavioral approaches to timing, the "gap" experiment and its implications, proportional timing and Weber's law, temporal dynamics and linear waiting, and the problem of simple chain-interval schedules. We review the long history of research on operant choice: the matching law, its extensions and problems, concurrent chain schedules, and self-control. We point out how linear waiting may be involved in timing, choice, and reinforcement schedules generally. There are prospects for a unified approach to all these areas.
引用
收藏
页码:115 / 144
页数:30
相关论文
共 50 条
[31]   Zebrafish forebrain and temporal conditioning [J].
Cheng, Ruey-Kuang ;
Jesuthasan, Suresh J. ;
Penney, Trevor B. .
PHILOSOPHICAL TRANSACTIONS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 2014, 369 (1637)
[32]   An Evaluation of Operant Behavioural Economics in Functional Communication Training for Severe Problem Behaviour [J].
Gilroy, Shawn P. ;
Ford, Haley L. ;
Boyd, R. Justin ;
O'Connor, Julia T. ;
Kurtz, Patricia F. .
DEVELOPMENTAL NEUROREHABILITATION, 2019, 22 (08) :553-564
[33]   No impact of repeated extinction exposures on operant responding maintained by different reinforcer rates [J].
Bai, John Y. H. ;
Podlesnik, Christopher A. .
BEHAVIOURAL PROCESSES, 2017, 138 :29-33
[34]   Effects of Negative Punishment on Culturants in a Situation of Concurrence between Operant Contingencies and Metacontingencies [J].
Monteiro Guimaraes, Thais Maria ;
Fernandes Picanco, Carlos Rafael ;
Tourinho, Emmanuel Zagury .
PERSPECTIVES ON BEHAVIOR SCIENCE, 2019, 42 (04) :733-750
[35]   MULTIPLE DETERMINANTS OF THE EFFECTS OF REINFORCEMENT MAGNITUDE ON FREE-OPERANT RESPONSE RATES [J].
REED, P .
JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR, 1991, 55 (01) :109-123
[36]   Operant Social Reward Decreases Incubation of Heroin Craving in Male and Female Rats [J].
Venniro, Marco ;
Russell, Trinity I. ;
Zhang, Michelle ;
Shaham, Yavin .
BIOLOGICAL PSYCHIATRY, 2019, 86 (11) :848-856
[37]   The effect of the magnitude of the food deprivation motivating operation on free operant preference in mice [J].
Lewon, Matthew ;
Hayes, Linda J. .
BEHAVIOURAL PROCESSES, 2015, 115 :135-142
[38]   Ethanol's effects on operant responding: Differentiating reinforcement efficacy and motor performance [J].
Petry, NM .
PHYSIOLOGY & BEHAVIOR, 1998, 64 (01) :117-122
[39]   Effects of reinforcer choice measured in single-operant and concurrent-schedule procedures [J].
Geckeler, AS ;
Libby, ME ;
Graff, RB ;
Ahearn, WH .
JOURNAL OF APPLIED BEHAVIOR ANALYSIS, 2000, 33 (03) :347-351
[40]   Value-free reinforcement learning: policy optimization as a minimal model of operant behavior [J].
Bennett, Daniel ;
Niv, Yael ;
Langdon, Angela J. .
CURRENT OPINION IN BEHAVIORAL SCIENCES, 2021, 41 :114-121