Protein Structured Reservoir Computing for Spike-Based Pattern Recognition

被引:11
作者
Tsakalos, Karolos-Alexandros [1 ]
Sirakoulis, Georgios Ch [1 ]
Adamatzky, Andrew [2 ]
Smith, Jim [3 ]
机构
[1] Democritus Univ Thrace, Dept Elect & Comp Engn, Xanthi 67100, Greece
[2] Univ West England, Unconvent Comp Lab, Bristol BS16 1QY, Avon, England
[3] Univ West England, Comp Sci Res Ctr, Bristol BS16 1QY, Avon, England
关键词
Reservoirs; Proteins; Training; Topology; Three-dimensional displays; Neurons; Nanoscale devices; Molecular networks; reservoir computing; liquid state machine; izhikevich model; remote supervised learning; pattern recognition; NETWORK; COMPUTATION; INFORMATION; PLASTICITY; STATES; LIGHT;
D O I
10.1109/TPDS.2021.3068826
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Nowadays we witness a miniaturisation trend in the semiconductor industry backed up by groundbreaking discoveries and designs in nanoscale characterisation and fabrication. To facilitate the trend and produce ever smaller, faster and cheaper computing devices, the size of nanoelectronic devices is now reaching the scale of atoms or molecules - a technical goal undoubtedly demanding for novel devices. Following the trend, we explore an unconventional route of implementing reservoir computing on a single protein molecule and introduce neuromorphic connectivity with a small-world networking property. We have chosen Izhikevich spiking neurons as elementary processors, corresponding to the atoms of verotoxin protein, and its molecule as a 'hardware' architecture of the communication networks connecting the processors. We apply on a single readout layer, various training methods in a supervised fashion to investigate whether the molecular structured Reservoir Computing (RC) system is capable to deal with machine learning benchmarks. We start with the Remote Supervised Method, based on Spike-Timing-Dependent-Plasticity, and carry on with linear regression and scaled conjugate gradient back-propagation training methods. The RC network is evaluated as a proof-of-concept on the handwritten digit images from the standard MNIST and the extended MNIST datasets and demonstrates acceptable classification accuracies in comparison with other similar approaches.
引用
收藏
页码:322 / 331
页数:10
相关论文
共 50 条
[41]   RESERVOIR COMPUTING WITH TRUNCATED NORMAL DISTRIBUTION FOR SPEECH EMOTION RECOGNITION [J].
Ibrahim, Hemin ;
Loo, Chu Kiong .
MALAYSIAN JOURNAL OF COMPUTER SCIENCE, 2022, 35 (02) :128-141
[42]   Reservoir Computing Ensembles for Multi-Object Behavior Recognition [J].
Yin, Jun ;
Meng, Yan .
2012 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2012,
[43]   Benchmark Comparisons of Spike-based Reconfigurable Neuroprocessor Architectures for Control Applications [J].
Foshie, Adam Z. ;
Rizzo, Charles ;
Das, Hritom ;
Zheng, ChaoHui ;
Plank, James S. ;
Rose, Garrett S. .
PROCEEDINGS OF THE 32ND GREAT LAKES SYMPOSIUM ON VLSI 2022, GLSVLSI 2022, 2022, :383-386
[44]   Using Spike-Based Bio-Inspired Olfactory Model for Data Processing in Electronic Noses [J].
Liu, Ying-Jie ;
Meng, Qing-Hao ;
Qi, Pei-Feng ;
Sun, Biao ;
Zhu, Xin-Shan .
IEEE SENSORS JOURNAL, 2018, 18 (02) :692-702
[45]   Structured neural networks for pattern recognition [J].
Murino, V .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 1998, 28 (04) :553-561
[46]   Key role of neuronal diversity in structured reservoir computing [J].
Thivierge, Jean-Philippe ;
Giraud, Eloise ;
Lynn, Michael ;
Charbonneau, Annie Theberge .
CHAOS, 2022, 32 (11)
[47]   FPGA based spike-time dependent encoder and reservoir design in neuromorphic computing processors [J].
Yi, Yang ;
Liao, Yongbo ;
Wang, Bin ;
Fu, Xin ;
Shen, Fangyang ;
Hou, Hongyan ;
Liu, Lingjia .
MICROPROCESSORS AND MICROSYSTEMS, 2016, 46 :175-183
[48]   A programmable spike-timing based circuit block for reconfigurable neuromorphic computing [J].
Koickal, Thomas Jacob ;
Gouveia, Luiz C. ;
Hamilton, Alister .
NEUROCOMPUTING, 2009, 72 (16-18) :3609-3616
[49]   Effective Surrogate Gradient Learning With High-Order Information Bottleneck for Spike-Based Machine Intelligence [J].
Yang, Shuangming ;
Chen, Badong .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (01) :1734-1748
[50]   Connected Digit Recognition by Means of Reservoir Computing [J].
Jalalvand, Azarakhsh ;
Triefenbach, Fabian ;
Verstraeten, David ;
Martens, Jean-Pierre .
12TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2011 (INTERSPEECH 2011), VOLS 1-5, 2011, :1736-1739