On-line identification and reconstruction of finite automata with generalized recurrent neural networks

被引:26
作者
Gabrijel, I [1 ]
Dobnikar, A [1 ]
机构
[1] Univ Ljubljana, Fac Comp & Informat Sci, SI-1001 Ljubljana, Slovenia
关键词
recurrent neural networks; system identification; finite automata; supervised learning; on-line learning; on-line rule extraction;
D O I
10.1016/S0893-6080(02)00221-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper finite automata are treated as general discrete dynamical systems from the viewpoint of systems theory. The unconditional online identification of an unknown finite automaton is the problem considered. A generalized architecture of recurrent neural networks with a corresponding on-line learning scheme is proposed as a solution to the problem. An on-line rule-extraction algorithm is further introduced. The architecture presented, the on-line learning scheme and the on-line rule-extraction method are tested on different, strongly connected automata, ranging from a very simple example with two states only to a more interesting and complex one with 64 states; the results of both training and extraction processes are very promising. (C) 2002 Elsevier Science Ltd. All rights reserved.
引用
收藏
页码:101 / 120
页数:20
相关论文
共 52 条
[1]  
ANGELINE PJ, 1994, P 3 INT C EV PROGR
[2]  
[Anonymous], HDB BRAIN THEORY NEU
[3]  
[Anonymous], 1973, FINITE AUTOMATA BEHA
[4]   Stable behavior in a recurrent neural network for a finite state machine [J].
Arai, K ;
Nakano, R .
NEURAL NETWORKS, 2000, 13 (06) :667-680
[5]  
Back T., 2000, EVOLUTIONARY COMPUTA, V1
[6]   LEARNING DYNAMICS - SYSTEM-IDENTIFICATION FOR PERCEPTUALLY CHALLENGED AGENTS [J].
BASYE, K ;
DEAN, T ;
KAELBLING, LP .
ARTIFICIAL INTELLIGENCE, 1995, 72 (1-2) :139-171
[7]   Analysis of dynamical recognizers [J].
Blair, AD ;
Pollack, JB .
NEURAL COMPUTATION, 1997, 9 (05) :1127-1142
[8]   The dynamics of discrete-time computation, with application to recurrent neural networks and finite state machine extraction (vol 8, pg 1135, 1996) [J].
Casey, M .
NEURAL COMPUTATION, 1998, 10 (05) :1067-1069
[9]   The dynamics of discrete-time computation, with application to recurrent neural networks and finite state machine extraction [J].
Casey, M .
NEURAL COMPUTATION, 1996, 8 (06) :1135-1178
[10]   Finite State Automata and Simple Recurrent Networks [J].
Cleeremans, Axel ;
Servan-Schreiber, David ;
McClelland, James L. .
NEURAL COMPUTATION, 1989, 1 (03) :372-381