Supervised learning through neuronal response modulation

被引:10
作者
Swinehart, CD [1 ]
Abbott, LF
机构
[1] Brandeis Univ, Volen Ctr, Waltham, MA 02454 USA
[2] Brandeis Univ, Dept Biol, Waltham, MA 02454 USA
关键词
D O I
10.1162/0899766053019980
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Neural networks that are trained to perform specific tasks must be developed through a supervised learning procedure. This normally takes the form of direct supervision of synaptic plasticity. We explore the idea that supervision takes place instead through the modulation of neuronal excitability. Such supervision can be done using conventional synaptic feedback pathways rather than requiring the hypothetical actions of unknown modulatory agents. During task learning, supervised response modulation guides Hebbian synaptic plasticity indirectly by establishing appropriate patterns of correlated network activity. This results in robust learning of function approximation tasks even when multiple output units representing different functions share large amounts of common input. Reward-based supervision is also studied, and a number of potential advantages of neuronal response modulation are identified.
引用
收藏
页码:609 / 631
页数:23
相关论文
共 24 条
  • [1] [Anonymous], 1993, Advances in neural information processing systems
  • [2] NEURONLIKE ADAPTIVE ELEMENTS THAT CAN SOLVE DIFFICULT LEARNING CONTROL-PROBLEMS
    BARTO, AG
    SUTTON, RS
    ANDERSON, CW
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1983, 13 (05): : 834 - 846
  • [3] Gain modulation from background synaptic input
    Chance, FS
    Abbott, LF
    Reyes, AD
    [J]. NEURON, 2002, 35 (04) : 773 - 782
  • [4] Chauvin Y., 1995, Back-propagation Theory, Architectures and Applications
  • [5] Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model
    Compte, A
    Brunel, N
    Goldman-Rakic, PS
    Wang, XJ
    [J]. CEREBRAL CORTEX, 2000, 10 (09) : 910 - 923
  • [6] Dayan P, 2001, THEORETICAL NEUROSCI
  • [7] Subtractive and divisive inhibition: Effect of voltage-dependent inhibitory conductances and noise
    Doiron, B
    Longtin, AAE
    Berman, N
    Maler, L
    [J]. NEURAL COMPUTATION, 2001, 13 (01) : 227 - 248
  • [8] Doya K., 1995, ADV NEURAL INFORMATI, V7, P101
  • [9] Hertz J., 1991, Introduction to the Theory of Neural Computation
  • [10] WEIGHT PERTURBATION - AN OPTIMAL ARCHITECTURE AND LEARNING TECHNIQUE FOR ANALOG VLSI FEEDFORWARD AND RECURRENT MULTILAYER NETWORKS
    JABRI, M
    FLOWER, B
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1992, 3 (01): : 154 - 157