Protein Structured Reservoir Computing for Spike-Based Pattern Recognition

被引:11
作者
Tsakalos, Karolos-Alexandros [1 ]
Sirakoulis, Georgios Ch [1 ]
Adamatzky, Andrew [2 ]
Smith, Jim [3 ]
机构
[1] Democritus Univ Thrace, Dept Elect & Comp Engn, Xanthi 67100, Greece
[2] Univ West England, Unconvent Comp Lab, Bristol BS16 1QY, Avon, England
[3] Univ West England, Comp Sci Res Ctr, Bristol BS16 1QY, Avon, England
关键词
Reservoirs; Proteins; Training; Topology; Three-dimensional displays; Neurons; Nanoscale devices; Molecular networks; reservoir computing; liquid state machine; izhikevich model; remote supervised learning; pattern recognition; NETWORK; COMPUTATION; INFORMATION; PLASTICITY; STATES; LIGHT;
D O I
10.1109/TPDS.2021.3068826
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Nowadays we witness a miniaturisation trend in the semiconductor industry backed up by groundbreaking discoveries and designs in nanoscale characterisation and fabrication. To facilitate the trend and produce ever smaller, faster and cheaper computing devices, the size of nanoelectronic devices is now reaching the scale of atoms or molecules - a technical goal undoubtedly demanding for novel devices. Following the trend, we explore an unconventional route of implementing reservoir computing on a single protein molecule and introduce neuromorphic connectivity with a small-world networking property. We have chosen Izhikevich spiking neurons as elementary processors, corresponding to the atoms of verotoxin protein, and its molecule as a 'hardware' architecture of the communication networks connecting the processors. We apply on a single readout layer, various training methods in a supervised fashion to investigate whether the molecular structured Reservoir Computing (RC) system is capable to deal with machine learning benchmarks. We start with the Remote Supervised Method, based on Spike-Timing-Dependent-Plasticity, and carry on with linear regression and scaled conjugate gradient back-propagation training methods. The RC network is evaluated as a proof-of-concept on the handwritten digit images from the standard MNIST and the extended MNIST datasets and demonstrates acceptable classification accuracies in comparison with other similar approaches.
引用
收藏
页码:322 / 331
页数:10
相关论文
共 50 条
[21]   Learning as filtering: Implications for spike-based plasticity [J].
Jegminat, Jannes ;
Surace, Simone Carlo J. ;
Pfister, Jean-Pascal .
PLOS COMPUTATIONAL BIOLOGY, 2022, 18 (02)
[22]   A Spike-Based Neuromorphic Architecture of Stereo Vision [J].
Risi, Nicoletta ;
Aimar, Alessandro ;
Donati, Elisa ;
Solinas, Sergio ;
Indiveri, Giacomo .
FRONTIERS IN NEUROROBOTICS, 2020, 14
[23]   The Time Machine: A novel spike-based computation architecture [J].
Garg, Vaibhav ;
Shekhar, Ravi ;
Harris, John G. .
2011 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2011, :685-688
[24]   Philosophy of the Spike: Rate-Based vs. Spike-Based Theories of the Brain [J].
Brette, Romain .
FRONTIERS IN SYSTEMS NEUROSCIENCE, 2015, 9
[25]   Reservoir computing with delay in structured networks [J].
Roehm, Andre ;
Luedge, Kathy .
NEURO-INSPIRED PHOTONIC COMPUTING, 2018, 10689
[26]   Chinese Herbal Medicine Recognition Using a VCSEL-Based Time-Delay Reservoir Computing System [J].
Yue, Dianzuo ;
Hou, Yushuang ;
Hu, Chunxia ;
Zang, Cunru ;
Kou, Yingzhe .
IEEE PHOTONICS JOURNAL, 2023, 15 (03)
[27]   A Simple Memristive Circuit for Pattern Classification Based on Reservoir Computing [J].
Tong, Zhiqiang ;
Nakane, Ryosho ;
Hirose, Akira ;
Tanaka, Gouhei .
INTERNATIONAL JOURNAL OF BIFURCATION AND CHAOS, 2022, 32 (09)
[28]   A VLSI neuromorphic device for implementing spike-based neural networks [J].
Indiveri, Giacomo ;
Chicca, Elisabetta .
NEURAL NETS WIRN11, 2011, 234 :305-316
[29]   Hardware-Amenable Structural Learning for Spike-Based Pattern Classification Using a Simple Model of Active Dendrites [J].
Hussain, Shaista ;
Liu, Shih-Chii ;
Basu, Arindam .
NEURAL COMPUTATION, 2015, 27 (04) :845-897
[30]   An Investigation into Spike-Based Neuromorphic Approaches for Artificial Olfactory Systems [J].
Vanarse, Anup ;
Osseiran, Adam ;
Rassau, Alexander .
SENSORS, 2017, 17 (11)