Recent advances in physical reservoir computing: A review

被引:1312
作者
Tanaka, Gouhei [1 ,2 ]
Yamane, Toshiyuki [3 ]
Heroux, Jean Benoit [3 ]
Nakane, Ryosho [1 ,2 ]
Kanazawa, Naoki [3 ]
Takeda, Seiji [3 ]
Numata, Hidetoshi [3 ]
Nakano, Daiju [3 ]
Hirose, Akira [1 ,2 ]
机构
[1] Univ Tokyo, Grad Sch Engn, Inst Innovat Int Engn Educ, Tokyo 1138656, Japan
[2] Univ Tokyo, Grad Sch Engn, Dept Elect Engn & Informat Syst, Tokyo 1138656, Japan
[3] IBM Res Tokyo, Kawasaki, Kanagawa 2120032, Japan
关键词
Neural networks; Machine learning; Reservoir computing; Nonlinear dynamical systems; Neuromorphic device; LIQUID-STATE MACHINES; NEURAL-NETWORKS; PATTERN-RECOGNITION; FADING-MEMORY; BACKPROPAGATION-DECORRELATION; SENTENCE COMPREHENSION; NATURAL-LANGUAGE; WORKING-MEMORY; PERFORMANCE; MODEL;
D O I
10.1016/j.neunet.2019.03.005
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Reservoir computing is a computational framework suited for temporal/sequential data processing. It is derived from several recurrent neural network models, including echo state networks and liquid state machines. A reservoir computing system consists of a reservoir for mapping inputs into a high-dimensional space and a readout for pattern analysis from the high-dimensional states in the reservoir. The reservoir is fixed and only the readout is trained with a simple method such as linear regression and classification. Thus, the major advantage of reservoir computing compared to other recurrent neural networks is fast learning, resulting in low training cost. Another advantage is that the reservoir without adaptive updating is amenable to hardware implementation using a variety of physical systems, substrates, and devices. In fact, such physical reservoir computing has attracted increasing attention in diverse fields of research. The purpose of this review is to provide an overview of recent advances in physical reservoir computing by classifying them according to the type of the reservoir. We discuss the current issues and perspectives related to physical reservoir computing, in order to further expand its practical applications and develop next-generation machine learning systems. (C) 2019 The Author(s). Published by Elsevier Ltd.
引用
收藏
页码:100 / 123
页数:24
相关论文
共 275 条
[1]  
Aaser P, 2017, FOURTEENTH EUROPEAN CONFERENCE ON ARTIFICIAL LIFE (ECAL 2017), P430
[2]   The case for rejecting the memristor as a fundamental circuit element [J].
Abraham, Isaac .
SCIENTIFIC REPORTS, 2018, 8
[3]  
ALBUS J S, 1971, Mathematical Biosciences, V10, P25, DOI 10.1016/0025-5564(71)90051-4
[4]  
Alomar ML, 2016, IEEE IJCNN, P1128, DOI 10.1109/IJCNN.2016.7727324
[5]  
Alomar ML, 2014, INT WORKS POW TIM
[6]  
[Anonymous], ARXIV170904310
[7]  
[Anonymous], ARXIV180300997
[8]  
[Anonymous], 2012, INT JOINT C NEURAL N, DOI [DOI 10.1109/IJCNN.2012.6252504, 10.1109/IJCNN.2012.6252504]
[9]  
[Anonymous], TECHNICAL REPORT
[10]  
[Anonymous], ARXIV180604932