Deep Photonic Reservoir Computer for Speech Recognition

被引:4
作者
Picco, Enrico [1 ]
Lupo, Alessandro [1 ]
Massar, Serge [1 ]
机构
[1] Univ Libre Bruxelles ULB, Lab Informat Quant, CP 224, B-1050 Brussels, Belgium
基金
欧盟地平线“2020”;
关键词
Reservoirs; Speech recognition; Computer architecture; Photonics; Training; Task analysis; Vectors; Audio processing; photonics; reservoir computing (RC); speech recognition; CLASSIFICATION; MACHINE; SYSTEMS;
D O I
10.1109/TNNLS.2024.3400451
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Speech recognition is a critical task in the field of artificial intelligence (AI) and has witnessed remarkable advancements thanks to large and complex neural networks, whose training process typically requires massive amounts of labeled data and computationally intensive operations. An alternative paradigm, reservoir computing (RC), is energy efficient and is well adapted to implementation in physical substrates, but exhibits limitations in performance when compared with more resource-intensive machine learning algorithms. In this work, we address this challenge by investigating different architectures of interconnected reservoirs, all falling under the umbrella of deep RC (DRC). We propose a photonic-based deep reservoir computer and evaluate its effectiveness on different speech recognition tasks. We show specific design choices that aim to simplify the practical implementation of a reservoir computer while simultaneously achieving high-speed processing of high-dimensional audio signals. Overall, with the present work, we hope to help the advancement of low-power and high-performance neuromorphic hardware.
引用
收藏
页码:7606 / 7614
页数:9
相关论文
共 66 条
[1]   Minimum complexity integrated photonic architecture for delay-based reservoir computing [J].
Abdalla, Mohab ;
Zrounba, Clement ;
Cardoso, Raphael ;
Jimenez, Paul ;
Ren, Guanghui ;
Boes, Andreas ;
Mitchell, Arnan ;
Bosio, Alberto ;
O'connor, Ian ;
Pavanello, Fabio .
OPTICS EXPRESS, 2023, 31 (07) :11610-11623
[2]  
[Anonymous], 1991, TI46 TEX INSTR
[3]   Bayesian Optimisation of Large-scale Photonic Reservoir Computers [J].
Antonik, Piotr ;
Marsal, Nicolas ;
Brunner, Daniel ;
Rontani, Damien .
COGNITIVE COMPUTATION, 2023, 15 (05) :1452-1460
[4]   Human action recognition with a large-scale brain-inspired photonic computer [J].
Antonik, Piotr ;
Marsal, Nicolas ;
Brunner, Daniel ;
Rontani, Damien .
NATURE MACHINE INTELLIGENCE, 2019, 1 (11) :530-537
[5]   Using a reservoir computer to learn chaotic attractors, with applications to chaos synchronization and cryptography [J].
Antonik, Piotr ;
Gulina, Marvyn ;
Pauwels, Jael ;
Massar, Serge .
PHYSICAL REVIEW E, 2018, 98 (01)
[6]   Online Training of an Opto-Electronic Reservoir Computer Applied to Real-Time Channel Equalization [J].
Antonik, Piotr ;
Duport, Francois ;
Hermans, Michiel ;
Smerieri, Anteo ;
Haelterman, Marc ;
Massar, Serge .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (11) :2686-2698
[7]   Brain-Inspired Photonic Signal Processor for Generating Periodic Patterns and Emulating Chaotic Systems [J].
Antonik, Piotr ;
Haelterman, Marc ;
Massar, Serge .
PHYSICAL REVIEW APPLIED, 2017, 7 (05)
[8]  
Antonik Piotr., 2018, Application of FPGA to Real-Time Machine Learning: Hardware Reservoir Computers and Software Image Processing
[9]   Information processing using a single dynamical node as complex system [J].
Appeltant, L. ;
Soriano, M. C. ;
Van der Sande, G. ;
Danckaert, J. ;
Massar, S. ;
Dambre, J. ;
Schrauwen, B. ;
Mirasso, C. R. ;
Fischer, I. .
NATURE COMMUNICATIONS, 2011, 2
[10]  
Brochu E., 2010, ARXIV PREPRINT ARXIV