Recent advances in physical reservoir computing: A review

被引:1312
作者
Tanaka, Gouhei [1 ,2 ]
Yamane, Toshiyuki [3 ]
Heroux, Jean Benoit [3 ]
Nakane, Ryosho [1 ,2 ]
Kanazawa, Naoki [3 ]
Takeda, Seiji [3 ]
Numata, Hidetoshi [3 ]
Nakano, Daiju [3 ]
Hirose, Akira [1 ,2 ]
机构
[1] Univ Tokyo, Grad Sch Engn, Inst Innovat Int Engn Educ, Tokyo 1138656, Japan
[2] Univ Tokyo, Grad Sch Engn, Dept Elect Engn & Informat Syst, Tokyo 1138656, Japan
[3] IBM Res Tokyo, Kawasaki, Kanagawa 2120032, Japan
关键词
Neural networks; Machine learning; Reservoir computing; Nonlinear dynamical systems; Neuromorphic device; LIQUID-STATE MACHINES; NEURAL-NETWORKS; PATTERN-RECOGNITION; FADING-MEMORY; BACKPROPAGATION-DECORRELATION; SENTENCE COMPREHENSION; NATURAL-LANGUAGE; WORKING-MEMORY; PERFORMANCE; MODEL;
D O I
10.1016/j.neunet.2019.03.005
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Reservoir computing is a computational framework suited for temporal/sequential data processing. It is derived from several recurrent neural network models, including echo state networks and liquid state machines. A reservoir computing system consists of a reservoir for mapping inputs into a high-dimensional space and a readout for pattern analysis from the high-dimensional states in the reservoir. The reservoir is fixed and only the readout is trained with a simple method such as linear regression and classification. Thus, the major advantage of reservoir computing compared to other recurrent neural networks is fast learning, resulting in low training cost. Another advantage is that the reservoir without adaptive updating is amenable to hardware implementation using a variety of physical systems, substrates, and devices. In fact, such physical reservoir computing has attracted increasing attention in diverse fields of research. The purpose of this review is to provide an overview of recent advances in physical reservoir computing by classifying them according to the type of the reservoir. We discuss the current issues and perspectives related to physical reservoir computing, in order to further expand its practical applications and develop next-generation machine learning systems. (C) 2019 The Author(s). Published by Elsevier Ltd.
引用
收藏
页码:100 / 123
页数:24
相关论文
共 275 条
[11]  
[Anonymous], 2018, PROC INT JOINT C NEU
[12]  
[Anonymous], 2012, KUNSTL INTELL, DOI DOI 10.1007/s13218-012-0204-5
[13]  
[Anonymous], 2005, ADV NEURAL INFORM PR
[14]  
[Anonymous], 2015, P 24 BELG DUTCH C MA
[15]  
[Anonymous], 259 CBCL
[16]  
[Anonymous], 2017, WILEY INTERDISCIPLIN
[17]  
[Anonymous], P 3 ACM INT C NAN CO
[18]  
[Anonymous], 2017, ARXIV170302806
[19]  
[Anonymous], FRONTIERS NEUROSCIEN
[20]  
[Anonymous], HDB BRAIN THEORY NEU