Self-Supervised Spiking Neural Networks applied to Digit Classification

被引:3
|
作者
Chamand, Benjamin [1 ]
Joly, Philippe [1 ]
机构
[1] Univ Toulouse, IRIT, CNRS, Toulouse INP,UT3, Toulouse, France
关键词
spiking neural networks; self-supervised learning; representation learning; computer vision;
D O I
10.1145/3549555.3549559
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The self-supervised learning (SSL) paradigm is a rapidly growing research area in recent years with promising results, especially in the field of image processing. In order for these models to converge towards the creation of discriminative representations, a data augmentation is applied to the input data that feeds two-branch networks. On the other hand, Spiking Neural Networks (SNNs) are attracting a growing community due to their ability to process temporal information, their low-energy consumption and their high biological plausibility. Thanks to the use of Poisson process stochasticity to encode the same data into different temporal representations, and the success of using surrogate gradient on learning, we propose a self-supervised learning method applied to an SNN network, and we make a preliminary study on the generated representations. We have shown its feasibility by training our architecture on a dataset of images of digits (MNIST), then we have evaluated the representations with two classification methods.
引用
收藏
页码:196 / 200
页数:5
相关论文
共 50 条
  • [1] Self-Supervised Contrastive Learning In Spiking Neural Networks
    Bahariasl, Yeganeh
    Kheradpisheh, Saeed Reza
    PROCEEDINGS OF THE 13TH IRANIAN/3RD INTERNATIONAL MACHINE VISION AND IMAGE PROCESSING CONFERENCE, MVIP, 2024, : 181 - 185
  • [2] Self-Supervised Optical Flow with Spiking Neural Networks and Event Based Cameras
    Chaney, Kenneth
    Panagopoulou, Artemis
    Lee, Chankyu
    Roy, Kaushik
    Daniilidis, Kostas
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 5892 - 5899
  • [3] Self-Supervised Learning of Event-Based Optical Flow with Spiking Neural Networks
    Hagenaars, Jesse J.
    Paredes-Valles, Federico
    de Croon, Guido C. H. E.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [4] Self-supervised short text classification with heterogeneous graph neural networks
    Cao, Meng
    Yuan, Jinliang
    Yu, Hualei
    Zhang, Baoming
    Wang, Chongjun
    EXPERT SYSTEMS, 2023, 40 (06)
  • [5] Semi-Supervised and Self-Supervised Classification with Multi-View Graph Neural Networks
    Yuan, Jinliang
    Yu, Hualei
    Cao, Meng
    Xu, Ming
    Xie, Junyuan
    Wang, Chongjun
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021, 2021, : 2466 - 2476
  • [6] Self-supervised hamiltonian mechanics neural networks
    Zhan, Youqiu
    2021 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS AND COMPUTER ENGINEERING (ICCECE), 2021, : 271 - 275
  • [7] Contextual Classification Using Self-Supervised Auxiliary Models for Deep Neural Networks
    Palacio, Sebastian
    Engle, Philipp
    Hees, Joern
    Dengel, Andreas
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 8937 - 8944
  • [8] Evolutionary Spiking Neural Networks for Solving Supervised Classification Problems
    Lopez-Vazquez, G.
    Ornelas-Rodriguez, M.
    Espinal, A.
    Soria-Alcaraz, J. A.
    Rojas-Dominguez, A.
    Puga-Soberanes, H. J.
    Carpio, J. M.
    Rostro-Gonzalez, H.
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2019, 2019
  • [9] Self-Supervised Learning Applied to Variable Star Semi-supervised Classification using LSTM and GRU Networks
    Merino, Roberto
    Jara, Pablo
    Peralta, Billy
    Nicolis, Orietta
    Lobel, Hans
    Caro, Luis
    2024 L LATIN AMERICAN COMPUTER CONFERENCE, CLEI 2024, 2024,
  • [10] Self-Supervised Neural Aggregation Networks for Human Parsing
    Zhao, Jian
    Li, Jianshu
    Nie, Xuecheng
    Zhao, Fang
    Chen, Yunpeng
    Wang, Zhecan
    Feng, Jiashi
    Yan, Shuicheng
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 1595 - 1603