Machine Learning Capabilities of a Simulated Cerebellum

被引:26
作者
Hausknecht, Matthew [1 ]
Li, Wen-Ke [2 ]
Mauk, Michael [2 ]
Stone, Peter [1 ]
机构
[1] Univ Texas Austin, Dept Comp Sci, Austin, TX 78712 USA
[2] Univ Texas Austin, Ctr Learning & Memory, Austin, TX 78712 USA
基金
美国国家科学基金会;
关键词
Cerebellar pattern recognition; cerebellum; inverted pendulum balancing (cart-pole); MNIST handwritten digit recognition; proportional-integral-derivative (PID) control; robot balance; PREDICTIVE MOTOR CONTROL; NETWORK MODEL; COORDINATION; CORTEX;
D O I
10.1109/TNNLS.2015.2512838
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper describes the learning and control capabilities of a biologically constrained bottom-up model of the mammalian cerebellum. Results are presented from six tasks: 1) eyelid conditioning; 2) pendulum balancing; 3) proportional-integral-derivative control; 4) robot balancing; 5) pattern recognition; and 6) MNIST handwritten digit recognition. These tasks span several paradigms of machine learning, including supervised learning, reinforcement learning, control, and pattern recognition. Results over these six domains indicate that the cerebellar simulation is capable of robustly identifying static input patterns even when randomized across the sensory apparatus. This capability allows the simulated cerebellum to perform several different supervised learning and control tasks. On the other hand, both reinforcement learning and temporal pattern recognition prove problematic due to the delayed nature of error signals and the simulator's inability to solve the credit assignment problem. These results are consistent with previous findings which hypothesize that in the human brain, the basal ganglia is responsible for reinforcement learning, while the cerebellum handles supervised learning.
引用
收藏
页码:510 / 522
页数:13
相关论文
共 47 条
  • [1] ALBUS J S, 1971, Mathematical Biosciences, V10, P25, DOI 10.1016/0025-5564(71)90051-4
  • [2] Albus J. S., 1981, BRAINS BEHAV ROBOTIC
  • [3] Anderson C. W., 1989, IEEE Control Systems Magazine, V9, P31, DOI 10.1109/37.24809
  • [4] PID control system analysis, design, and technology
    Ang, KH
    Chong, G
    Li, Y
    [J]. IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2005, 13 (04) : 559 - 576
  • [5] [Anonymous], 2008, J PHYS AGENTS, DOI 10.14198/JoPha.2008.2.1.03
  • [6] [Anonymous], 1984, The cerebellum and neural control
  • [7] [Anonymous], TECH REP
  • [8] [Anonymous], CURRENT OPINION NEUR
  • [9] Assad C, 2005, IEEE SYS MAN CYBERN, P877
  • [10] NEURONLIKE ADAPTIVE ELEMENTS THAT CAN SOLVE DIFFICULT LEARNING CONTROL-PROBLEMS
    BARTO, AG
    SUTTON, RS
    ANDERSON, CW
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1983, 13 (05): : 834 - 846