Extinction from a rationalist perspective

被引:45
作者
Gallistel, C. R. [1 ]
机构
[1] Rutgers State Univ, Piscataway, NJ 08854 USA
关键词
Acquisition; Extinction; Partial reinforcement; Spontaneous recovery; Renewal; Reinstatement; Resurgence; Information theory; Bayesian inference; PARTIAL-REINFORCEMENT; SPONTANEOUS-RECOVERY; BEHAVIORAL MOMENTUM; TIME; ACQUISITION; ASSOCIATIONS; MEMORY; INTERFERENCE; PRESERVATION; INFORMATION;
D O I
10.1016/j.beproc.2012.02.008
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The merging of the computational theory of mind and evolutionary thinking leads to a kind of rationalism, in which enduring truths about the world have become implicit in the computations that enable the brain to cope with the experienced world. The dead reckoning computation, for example, is implemented within the brains of animals as one of the mechanisms that enables them to learn where they are (Gallistel, 1990, 1995). It integrates a velocity signal with respect to a time signal. Thus, the manner in which position and velocity relate to one another in the world is reflected in the manner in which signals representing those variables are processed in the brain. I use principles of information theory and Bayesian inference to derive from other simple principles explanations for: (1) the failure of partial reinforcement to increase reinforcements to acquisition: (2) the partial reinforcement extinction effect: (3) spontaneous recovery: (4) renewal; (5) reinstatement; (6) resurgence (aka facilitated reacquisition). Like the principle underlying dead-reckoning, these principles are grounded in analytic considerations. They are the kind of enduring truths about the world that are likely to have shaped the brain's computations. (C) 2012 Elsevier B.V. All rights reserved.
引用
收藏
页码:66 / 80
页数:15
相关论文
共 81 条
[51]   SUCCESSIVE ACQUISITIONS AND EXTINCTIONS OF A JUMPING HABIT IN RELATION TO SCHEDULE OF REINFORCEMENT [J].
LAUER, DW ;
ESTES, WK .
JOURNAL OF COMPARATIVE AND PHYSIOLOGICAL PSYCHOLOGY, 1955, 48 (01) :8-13
[52]   PARTIAL-REINFORCEMENT - A SELECTIVE REVIEW OF THE LITERATURE SINCE 1950 [J].
LEWIS, DJ .
PSYCHOLOGICAL BULLETIN, 1960, 57 (01) :1-28
[53]   Toward a richer view of the scientific method - The role of conceptual analysis [J].
Machado, Armando ;
Silva, Francisco J. .
AMERICAN PSYCHOLOGIST, 2007, 62 (07) :671-681
[54]   THEORY OF ATTENTION - VARIATIONS IN ASSOCIABILITY OF STIMULI WITH REINFORCEMENT [J].
MACKINTOSH, NJ .
PSYCHOLOGICAL REVIEW, 1975, 82 (04) :276-298
[55]   Random sampling of deterministic signals: Statistical analysis of Fourier transform estimates [J].
Masry, E .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (05) :1750-1761
[56]   An elemental model of associative learning: I. Latent inhibition and perceptual learning [J].
McLaren, IPL ;
Mackintosh, NJ .
ANIMAL LEARNING & BEHAVIOR, 2000, 28 (03) :211-246
[57]   HABIT STRENGTH AS A FUNCTION OF THE PATTERN OF REINFORCEMENT [J].
MOWRER, OH ;
JONES, H .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 1945, 35 (04) :293-311
[58]   Different mechanisms of fear extinction dependent on length of time since fear acquisition [J].
Myers, KM ;
Ressler, KJ ;
Davis, M .
LEARNING & MEMORY, 2006, 13 (02) :216-223
[59]   Behavioral momentum and the Law of Effect [J].
Nevin, JA ;
Grace, RC .
BEHAVIORAL AND BRAIN SCIENCES, 2000, 23 (01) :73-+
[60]  
Pavlov I, 1927, CONDITIONED RELFEXES