Operant conditioning

被引:223
作者
Staddon, JER [1 ]
Cerutti, DT [1 ]
机构
[1] Duke Univ, Dept Psychol & Brain Sci, Durham, NC 27708 USA
关键词
interval timing; choice; concurrent schedules; matching law; self-control;
D O I
10.1146/annurev.psych.54.101601.145124
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Operant behavior is behavior "controlled" by its consequences. In practice, operant conditioning is the study of reversible behavior maintained by reinforcement schedules. We review empirical studies and theoretical approaches to two large classes of operant behavior: interval timing and choice. We discuss cognitive versus behavioral approaches to timing, the "gap" experiment and its implications, proportional timing and Weber's law, temporal dynamics and linear waiting, and the problem of simple chain-interval schedules. We review the long history of research on operant choice: the matching law, its extensions and problems, concurrent chain schedules, and self-control. We point out how linear waiting may be involved in timing, choice, and reinforcement schedules generally. There are prospects for a unified approach to all these areas.
引用
收藏
页码:115 / 144
页数:30
相关论文
共 50 条
  • [21] Stock optimizing in choice when a token deposit is the operant
    Widholm, JJ
    Silberberg, A
    Hursh, SR
    Imam, AA
    Warren-Boulton, FR
    JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR, 2001, 76 (03) : 245 - 263
  • [22] Challenges to timing-based theories of operant behavior
    Williams, BA
    BEHAVIOURAL PROCESSES, 2003, 62 (1-3) : 115 - 123
  • [23] Extending stimulus preference assessment with the operant demand framework
    Gilroy, Shawn P.
    Waits, Jodie A.
    Feck, Cassie
    JOURNAL OF APPLIED BEHAVIOR ANALYSIS, 2021, 54 (03) : 1032 - 1044
  • [24] The Interplay between Operant Behavioral Economics and Cognitive Accounts of Behavior
    Furreboe, Elise Frolich
    REVIEW OF BEHAVIORAL ECONOMICS, 2024, 11 (03): : 295 - 311
  • [26] ALTERNATIVE REINFORCEMENT INCREASES RESISTANCE TO CHANGE - PAVLOVIAN OR OPERANT CONTINGENCIES
    NEVIN, JA
    TOTA, ME
    TORQUATO, RD
    SHULL, RL
    JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR, 1990, 53 (03) : 359 - 379
  • [27] On the statistical properties of operant settings and their contribution to the evaluation of sensitivity to reinforcement
    Caron, Pier-Olivier
    ADAPTIVE BEHAVIOR, 2017, 25 (04) : 185 - 193
  • [28] Pharmacological studies of performance on the free-operant psychophysical procedure
    Body, S.
    Cheung, T. H. C.
    Valencia-Torres, L.
    Olarte-Sanchez, C. M.
    Fone, K. C. F.
    Bradshaw, C. M.
    Szabadi, E.
    BEHAVIOURAL PROCESSES, 2013, 95 : 71 - 89
  • [29] Spatial Generalization in Operant Learning: Lessons from Professional Basketball
    Neiman, Tal
    Loewenstein, Yonatan
    PLOS COMPUTATIONAL BIOLOGY, 2014, 10 (05)
  • [30] Influence of amount and delay of reward on choice and response rate: A free-operant, multiple-schedule analogue of a discrete-trial procedure
    Wright, James E.
    Reed, Phil
    JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR, 2024, 122 (03) : 259 - 269