Training and extraction of fuzzy finite state automata in recurrent neural networks

被引:0
作者
Chandra, Rohitash
Omlin, Christian W.
机构
来源
PROCEEDINGS OF THE SECOND IASTED INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE | 2006年
关键词
recurrent neural network; knowledge extraction; fuzzy finite-state automata; Trakhtenbrot-Barzdin algorithm;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a machine learning approach for the extraction of fuzzy finite-state automata (FFAs) from recurrent neural networks. After successful training on strings with fuzzy membership t c [0,I], we apply a generalisation of the Trakhtenbrot-Barzdin algorithm to extract FFAs in symbolic form from the trained network using the string labelling assigned by the trained network. Our results demonstrate that the approach successfully extracts the correct deterministic equivalent automata for strings much shorter than the longest string in the training set.
引用
收藏
页码:271 / 275
页数:5
相关论文
共 20 条
[1]  
CELLIER FE, 1995, J SYST ENG, V5, P207
[2]  
Das S., 1991, Computer Science and Informatics, V21, P35
[3]  
DUBOIS D, 1980, MATH SCI ENG, V14, P220
[4]   FINDING STRUCTURE IN TIME [J].
ELMAN, JL .
COGNITIVE SCIENCE, 1990, 14 (02) :179-211
[5]   Equivalence in knowledge representation: Automata, recurrent neural networks, and dynamical fuzzy systems [J].
Giles, CL ;
Omlin, CW ;
Thornber, KK .
PROCEEDINGS OF THE IEEE, 1999, 87 (09) :1623-1640
[6]   Rule inference for financial prediction using recurrent neural networks [J].
Giles, CL ;
Lawrence, S ;
Tsoi, AC .
PROCEEDINGS OF THE IEEE/IAFE 1997 COMPUTATIONAL INTELLIGENCE FOR FINANCIAL ENGINEERING (CIFER), 1997, :253-259
[7]  
Hochreiter S, 1997, NEURAL COMPUT, V9, P1735, DOI [10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]
[8]   Rule extraction from recurrent neural networks: A taxonomy and review [J].
Jacobsson, H .
NEURAL COMPUTATION, 2005, 17 (06) :1223-1263
[9]  
Kosmatopoulos E. B., 1996, International Journal of Intelligent Control and Systems, V1, P223, DOI 10.1142/S0218796596000143
[10]   HIGH-ORDER NEURAL-NETWORK STRUCTURES FOR IDENTIFICATION OF DYNAMICAL-SYSTEMS [J].
KOSMATOPOULOS, EB ;
POLYCARPOU, MM ;
CHRISTODOULOU, MA ;
IOANNOU, PA .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1995, 6 (02) :422-431