Transfer Learning with Sparse Associative Memories

被引：0

作者：

Jodelet, Quentin ^{[1
,2
]}

Gripon, Vincent ^{[1
]}

Hagiwara, Masafumi ^{[2
]}

机构：

[1] IMT Atlantique, Technopole Brest Iroise, F-29238 Brest, France

[2] Keio Univ, Yagami Campus, Yokohama, Kanagawa 2238522, Japan

来源：

ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2019: THEORETICAL NEURAL COMPUTATION, PT I | 2019年 / 11727卷

关键词：

Neural Networks; Associative Memories; Self-organizing Maps; Deep learning; Transfer learning; Incremental learning; Computer vision; NETWORKS;

D O I：

10.1007/978-3-030-30487-4_39

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

In this paper, we introduce a novel layer designed to be used as the output of pre-trained neural networks in the context of classification. Based on Associative Memories, this layer can help design deep neural networks which support incremental learning and that can be (partially) trained in real time on embedded devices. Experiments on the ImageNet dataset and other different domain specific datasets show that it is possible to design more flexible and faster-to-train Neural Networks at the cost of a slight decrease in accuracy.

引用

页码：497 / 512

页数：16

共 50 条

[21] A LEARNING AND FORGETTING ALGORITHM IN ASSOCIATIVE MEMORIES - THE EIGENSTRUCTURE METHOD
YEN, G
MICHEL, AN
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 1992, 39 (04) : 212 - 225
[22] OPTIMIZING SYNAPTIC LEARNING RULES IN LINEAR ASSOCIATIVE MEMORIES
DAYAN, P
WILLSHAW, DJ
BIOLOGICAL CYBERNETICS, 1991, 65 (04) : 253 - 265
[23] Sparse Structured Associative Memories as Efficient Set-Membership Data Structures
Gripon, Vincent
Skachek, Vitaly
Rabbat, Michael
2013 51ST ANNUAL ALLERTON CONFERENCE ON COMMUNICATION, CONTROL, AND COMPUTING (ALLERTON), 2013, : 500 - 505
[24] ASSOCIATIVE MEMORIES
KRIGMAN, A
INSTRUMENTS & CONTROL SYSTEMS, 1972, 45 (03): : 35 - +
[25] Competitive learning to generate sparse representations for associative memory
Sacouto, Luis
Wichert, Andreas
NEURAL NETWORKS, 2023, 168 : 32 - 43
[26] Sparse Odor Representation in the Mushroom Body and Associative Learning
Ito, Iori
Ong, Rose C.
Raman, Baranidharan
Stopfer, Mark
CHEMICAL SENSES, 2008, 33 (08) : S80 - S80
[27] Statistical mechanics of learning via reverberation in bidirectional associative memories
Centonze, Martino Salomone
Kanter, Ido
Barra, Adriano
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2024, 637
[28] Simplification Of The Learning Phase In The Alpha-Beta Associative Memories
Edgar A, Catalan Salgado
Yanez-Marquez, Cornelio
Amadeo Jose, Argueelles Cruz
CERMA 2008: ELECTRONICS, ROBOTICS AND AUTOMOTIVE MECHANICS CONFERENCE, PROCEEDINGS, 2008, : 428 - +
[29] Associative Learning: How nitric oxide helps update memories
Green, Daniel J. E.
Lin, Andrew C.
ELIFE, 2020, 9
[30] Attractor networks and associative memories with STDP learning in RRAM synapses
Milo, V.
Ielmini, D.
Chicca, E.
2017 IEEE INTERNATIONAL ELECTRON DEVICES MEETING (IEDM), 2017,

← 1 2 3 4 5 →