Deep Photonic Reservoir Computer for Speech Recognition

被引:4
作者
Picco, Enrico [1 ]
Lupo, Alessandro [1 ]
Massar, Serge [1 ]
机构
[1] Univ Libre Bruxelles ULB, Lab Informat Quant, CP 224, B-1050 Brussels, Belgium
基金
欧盟地平线“2020”;
关键词
Reservoirs; Speech recognition; Computer architecture; Photonics; Training; Task analysis; Vectors; Audio processing; photonics; reservoir computing (RC); speech recognition; CLASSIFICATION; MACHINE; SYSTEMS;
D O I
10.1109/TNNLS.2024.3400451
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Speech recognition is a critical task in the field of artificial intelligence (AI) and has witnessed remarkable advancements thanks to large and complex neural networks, whose training process typically requires massive amounts of labeled data and computationally intensive operations. An alternative paradigm, reservoir computing (RC), is energy efficient and is well adapted to implementation in physical substrates, but exhibits limitations in performance when compared with more resource-intensive machine learning algorithms. In this work, we address this challenge by investigating different architectures of interconnected reservoirs, all falling under the umbrella of deep RC (DRC). We propose a photonic-based deep reservoir computer and evaluate its effectiveness on different speech recognition tasks. We show specific design choices that aim to simplify the practical implementation of a reservoir computer while simultaneously achieving high-speed processing of high-dimensional audio signals. Overall, with the present work, we hope to help the advancement of low-power and high-performance neuromorphic hardware.
引用
收藏
页码:7606 / 7614
页数:9
相关论文
共 66 条
[31]   Multidimensional curve classification using passing-through regions [J].
Kudo, M ;
Toyama, J ;
Shimbo, M .
PATTERN RECOGNITION LETTERS, 1999, 20 (11-13) :1103-1111
[32]   Photonic information processing beyond Turing: an optoelectronic implementation of reservoir computing [J].
Larger, L. ;
Soriano, M. C. ;
Brunner, D. ;
Appeltant, L. ;
Gutierrez, J. M. ;
Pesquera, L. ;
Mirasso, C. R. ;
Fischer, I. .
OPTICS EXPRESS, 2012, 20 (03) :3241-3249
[33]   Imaging With Nature: Compressive Imaging Using a Multiply Scattering Medium [J].
Liutkus, Antoine ;
Martina, David ;
Popoff, Sebastien ;
Chardon, Gilles ;
Katz, Ori ;
Lerosey, Geoffroy ;
Gigan, Sylvain ;
Daudet, Laurent ;
Carron, Igor .
SCIENTIFIC REPORTS, 2014, 4
[34]   Photonic neuromorphic information processing and reservoir computing [J].
Lugnan, A. ;
Katumba, A. ;
Laporte, F. ;
Freiberger, M. ;
Sackesyn, S. ;
Ma, C. ;
Gooskens, E. ;
Dambre, J. ;
Bienstman, P. .
APL PHOTONICS, 2020, 5 (02)
[35]   Reservoir computing approaches to recurrent neural network training [J].
Lukosevicius, Mantas ;
Jaeger, Herbert .
COMPUTER SCIENCE REVIEW, 2009, 3 (03) :127-149
[36]   Deep photonic reservoir computer based on frequency multiplexing with fully analog connection between layers [J].
Lupo, Alessandro ;
Picco, Enrico ;
Zajnulina, Marina ;
Massar, Serge .
OPTICA, 2023, 10 (11) :1478-1485
[37]  
Lyon R. F., 1982, Proceedings of ICASSP 82. IEEE International Conference on Acoustics, Speech and Signal Processing, P1282
[38]   DeePr-ESN: A deep projection-encoding echo-state network [J].
Ma, Qianli ;
Shen, Lifeng ;
Cottrell, Garrison W. .
INFORMATION SCIENCES, 2020, 511 :152-171
[39]   Real-time computing without stable states:: A new framework for neural computation based on perturbations [J].
Maass, W ;
Natschläger, T ;
Markram, H .
NEURAL COMPUTATION, 2002, 14 (11) :2531-2560
[40]   Photonic Nonlinear Transient Computing with Multiple-Delay Wavelength Dynamics [J].
Martinenghi, Romain ;
Rybalko, Sergei ;
Jacquot, Maxime ;
Chembo, Yanne K. ;
Larger, Laurent .
PHYSICAL REVIEW LETTERS, 2012, 108 (24)