Computational Advantages of Deep Prototype-Based Learning

被引:3
作者
Hecht, Thomas [1 ]
Gepperth, Alexander [1 ]
机构
[1] Univ Paris Saclay, Inria, Flowers Team, U2IS, 828 Blvd Marechaux, F-91762 Palaiseau, France
来源
ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2016, PT II | 2016年 / 9887卷
关键词
Prototype-based learning; Pattern recognition; Deep learning; Incremental learning;
D O I
10.1007/978-3-319-44781-0_15
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a deep prototype-based learning architecture which achieves a performance that is competitive to a conventional, shallow prototype-based model but at a fraction of the computational cost, especially w.r.t. memory requirements. As prototype-based classification and regression methods are typically plagued by the exploding number of prototypes necessary to solve complex problems, this is an important step towards efficient prototype-based classification and regression. We demonstrate these claims by benchmarking our deep prototype-based model on the well-known MNIST dataset.
引用
收藏
页码:121 / 127
页数:7
相关论文
共 12 条
[1]  
[Anonymous], 2016, EUROPEAN S ARTIFICIA
[2]   A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking [J].
Arulampalam, MS ;
Maskell, S ;
Gordon, N ;
Clapp, T .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2002, 50 (02) :174-188
[3]  
Biehl M, 2007, J MACH LEARN RES, V8, P323
[4]  
Carse B, 1996, PARALLEL PROBLEM SOL, V4, P707
[5]  
Gepperth A., 2015, COGN COMPUT
[6]   SELF-ORGANIZED FORMATION OF TOPOLOGICALLY CORRECT FEATURE MAPS [J].
KOHONEN, T .
BIOLOGICAL CYBERNETICS, 1982, 43 (01) :59-69
[7]   Gradient-based learning applied to document recognition [J].
Lecun, Y ;
Bottou, L ;
Bengio, Y ;
Haffner, P .
PROCEEDINGS OF THE IEEE, 1998, 86 (11) :2278-2324
[8]  
Losing V., 2015, IEEE
[9]   Fast Learning in Networks of Locally-Tuned Processing Units [J].
Moody, John ;
Darken, Christian J. .
NEURAL COMPUTATION, 1989, 1 (02) :281-294
[10]   COGNITIVE REFERENCE POINTS [J].
ROSCH, E .
COGNITIVE PSYCHOLOGY, 1975, 7 (04) :532-547