Dynamic memristor-based reservoir computing for high-efficiency temporal signal processing

被引:433
作者
Zhong, Yanan [1 ]
Tang, Jianshi [1 ,2 ]
Li, Xinyi [1 ]
Gao, Bin [1 ,2 ]
Qian, He [1 ,2 ]
Wu, Huaqiang [1 ,2 ]
机构
[1] Tsinghua Univ, Beijing Innovat Ctr Future Chips ICFC, Inst Microelect, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol BNRis, Beijing 100084, Peoples R China
关键词
SYSTEMS;
D O I
10.1038/s41467-020-20692-1
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Reservoir computing is a highly efficient network for processing temporal signals due to its low training cost compared to standard recurrent neural networks, and generating rich reservoir states is critical in the hardware implementation. In this work, we report a parallel dynamic memristor-based reservoir computing system by applying a controllable mask process, in which the critical parameters, including state richness, feedback strength and input scaling, can be tuned by changing the mask length and the range of input signal. Our system achieves a low word error rate of 0.4% in the spoken-digit recognition and low normalized root mean square error of 0.046 in the time-series prediction of the Henon map, which outperforms most existing hardware-based reservoir computing systems and also software-based one in the Henon map prediction task. Our work could pave the road towards high-efficiency memristor-based reservoir computing systems to handle more complex temporal tasks in the future. Designing efficient neuromorphic systems for complex temporal tasks remains a challenge. Zhong et al. develop a parallel memristor-based reservoir computing system capable of tuning critical parameters, achieving classification accuracy of 99.6% in spoken-digit recognition and time-series prediction error of 0.046 in the Henon map.
引用
收藏
页数:9
相关论文
共 45 条
[1]   Online Training of an Opto-Electronic Reservoir Computer Applied to Real-Time Channel Equalization [J].
Antonik, Piotr ;
Duport, Francois ;
Hermans, Michiel ;
Smerieri, Anteo ;
Haelterman, Marc ;
Massar, Serge .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (11) :2686-2698
[2]   Information processing using a single dynamical node as complex system [J].
Appeltant, L. ;
Soriano, M. C. ;
Van der Sande, G. ;
Danckaert, J. ;
Massar, S. ;
Dambre, J. ;
Schrauwen, B. ;
Mirasso, C. R. ;
Fischer, I. .
NATURE COMMUNICATIONS, 2011, 2
[3]  
Bürger J, 2013, PROCEEDINGS OF THE 2013 IEEE/ACM INTERNATIONAL SYMPOSIUM ON NANOSCALE ARCHITECTURES (NANOARCH), P1, DOI 10.1109/NanoArch.2013.6623028
[4]   A fully integrated reprogrammable memristor-CMOS system for efficient multiply-accumulate operations [J].
Cai, Fuxi ;
Correll, Justin M. ;
Lee, Seung Hwan ;
Lim, Yong ;
Bothra, Vishishtha ;
Zhang, Zhengya ;
Flynn, Michael P. ;
Lu, Wei D. .
NATURE ELECTRONICS, 2019, 2 (07) :290-299
[5]   Short-Term Memory to Long-Term Memory Transition in a Nanoscale Memristor [J].
Chang, Ting ;
Jo, Sung-Hyun ;
Lu, Wei .
ACS NANO, 2011, 5 (09) :7669-7676
[6]   DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving [J].
Chen, Chenyi ;
Seff, Ari ;
Kornhauser, Alain ;
Xiao, Jianxiong .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :2722-2730
[7]   MEMRISTOR - MISSING CIRCUIT ELEMENT [J].
CHUA, LO .
IEEE TRANSACTIONS ON CIRCUIT THEORY, 1971, CT18 (05) :507-+
[8]  
Deng L, 2013, INT CONF ACOUST SPEE, P8604, DOI 10.1109/ICASSP.2013.6639345
[9]   Reservoir computing using dynamic memristors for temporal information processing [J].
Du, Chao ;
Cai, Fuxi ;
Zidan, Mohammed A. ;
Ma, Wen ;
Lee, Seung Hwan ;
Lu, Wei D. .
NATURE COMMUNICATIONS, 2017, 8
[10]  
Henon Michel, 2004, The theory of chaotic attractors, P94