Self-Supervised Spiking Neural Networks applied to Digit Classification

被引:3
|
作者
Chamand, Benjamin [1 ]
Joly, Philippe [1 ]
机构
[1] Univ Toulouse, IRIT, CNRS, Toulouse INP,UT3, Toulouse, France
关键词
spiking neural networks; self-supervised learning; representation learning; computer vision;
D O I
10.1145/3549555.3549559
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The self-supervised learning (SSL) paradigm is a rapidly growing research area in recent years with promising results, especially in the field of image processing. In order for these models to converge towards the creation of discriminative representations, a data augmentation is applied to the input data that feeds two-branch networks. On the other hand, Spiking Neural Networks (SNNs) are attracting a growing community due to their ability to process temporal information, their low-energy consumption and their high biological plausibility. Thanks to the use of Poisson process stochasticity to encode the same data into different temporal representations, and the success of using surrogate gradient on learning, we propose a self-supervised learning method applied to an SNN network, and we make a preliminary study on the generated representations. We have shown its feasibility by training our architecture on a dataset of images of digits (MNIST), then we have evaluated the representations with two classification methods.
引用
收藏
页码:196 / 200
页数:5
相关论文
共 50 条
  • [21] Visualization of Supervised and Self-Supervised Neural Networks via Attribution Guided Factorization
    Gur, Shir
    Ali, Ameen
    Wolf, Lior
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 11545 - 11554
  • [22] Self-Supervised Learning of Graph Neural Networks: A Unified Review
    Xie, Yaochen
    Xu, Zhao
    Zhang, Jingtun
    Wang, Zhengyang
    Ji, Shuiwang
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (02) : 2412 - 2429
  • [23] Self-Supervised Graph Structure Refinement for Graph Neural Networks
    Zhao, Jianan
    Wen, Qianlong
    Ju, Mingxuan
    Zhang, Chuxu
    Ye, Yanfang
    arXiv, 2022,
  • [24] Supervised learning with spiking neural networks
    Xin, JG
    Embrechts, MJ
    IJCNN'01: INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2001, : 1772 - 1777
  • [25] On the Fault Tolerance of Self-Supervised Training in Convolutional Neural Networks
    Milazzo, Rosario
    De Marco, Vincenzo
    De Sio, Corrado
    Fosson, Sophie
    Morra, Lia
    Sterpone, Luca
    2024 27TH INTERNATIONAL SYMPOSIUM ON DESIGN & DIAGNOSTICS OF ELECTRONIC CIRCUITS & SYSTEMS, DDECS, 2024, : 110 - 115
  • [26] Multitemporal Speckle Reduction With Self-Supervised Deep Neural Networks
    Meraoumia, Ines
    Dalsasso, Emanuele
    Denis, Loic
    Abergel, Remy
    Tupin, Florence
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [27] Self-supervised graph neural networks for polymer property prediction
    Gao, Qinghe
    Dukker, Tammo
    Schweidtmann, Artur M.
    Weber, Jana M.
    MOLECULAR SYSTEMS DESIGN & ENGINEERING, 2024, 9 (11): : 1130 - 1143
  • [28] Self-supervised Neural Networks for Spectral Snapshot Compressive Imaging
    Meng, Ziyi
    Yu, Zhenming
    Xu, Kun
    Yuan, Xin
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 2602 - 2611
  • [29] SelfGNN: Self-Supervised Graph Neural Networks for Sequential Recommendation
    Liu, Yuxi
    Xia, Lianghao
    Huang, Chao
    PROCEEDINGS OF THE 47TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2024, 2024, : 1609 - 1618
  • [30] Contrastive signal-dependent plasticity: Self-supervised learning in spiking neural circuits
    Ororbia, Alexander G.
    SCIENCE ADVANCES, 2024, 10 (43):