Exploiting similarity in system identification tasks with recurrent neural networks

被引:6
作者
Spieckermann, Sigurd [1 ,2 ]
Duell, Siegmund [1 ,3 ]
Udluft, Steffen [1 ]
Hentschel, Alexander [1 ]
Runkler, Thomas [1 ,2 ]
机构
[1] Siemens Corp Technol, Learning Syst, D-81739 Munich, Germany
[2] Tech Univ Munich, Dept Informat, D-85748 Garching, Germany
[3] Berlin Univ Technol, Machine Learning, D-10587 Berlin, Germany
关键词
Multi-task learning; Recurrent neural network; Factored tensor recurrent neural network; System identification; Dynamical system;
D O I
10.1016/j.neucom.2014.11.074
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A novel dual-task learning approach based on recurrent neural networks with factored tensor components for system identification tasks is presented. The goal is to identify the dynamics of a system given few observations which are augmented by auxiliary data from a similar system. The problem is motivated by real-world use cases and a mathematical problem description is given. Further, our proposed model the factored tensor recurrent neural network (FTRNN)-and two alternative models are introduced which are benchmarked on the cart-pole and mountain car simulations. We show that the FTRNN consistently and significantly outperformed the competing models in accuracy and data-efficiency. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:343 / 349
页数:7
相关论文
共 18 条
[1]  
[Anonymous], P 10 INT C MACH LEAR
[2]  
[Anonymous], 2010, P PYTHON SCI COMPUTI
[3]  
[Anonymous], 2011, ICML
[4]  
[Anonymous], CORRECT EQUATIONS DY
[5]  
[Anonymous], 2011, P 28 INT C MACH LEAR
[6]  
[Anonymous], 1998, REINFORCEMENT LEARNI
[7]   A recurrent neural network for modelling dynamical systems [J].
Bailer-Jones, CAL ;
MacKay, DJC ;
Withers, PJ .
NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1998, 9 (04) :531-547
[8]  
Bengio Y., 2012, P ICML WORKSH UNS TR, V7, P19
[9]  
Dull S., 2012, NEURAL NETWORKS TRIC, P709
[10]  
Dull S., 2010, P 18 EUR S ART NEUR