Reinforcement Learning-Based Differential Evolution With Cooperative Coevolution for a Compensatory Neuro-Fuzzy Controller

被引:17
作者
Chen, Cheng-Hung [1 ]
Liu, Chong-Bin [1 ]
机构
[1] Natl Formosa Univ, Dept Elect Engn, Huwei Township 632, Yunlin, Taiwan
关键词
Cooperative coevolution; differential evolution (DE); neuro-fuzzy controller (NFC); nonlinear system problems; reinforcement learning; NONLINEAR CONTROL; OPTIMIZATION; SYSTEM; IDENTIFICATION; NETWORKS; ALGORITHM;
D O I
10.1109/TNNLS.2017.2772870
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents the integration of reinforcement learning-based differential evolution (DE) with the cooperative coevolution (R-CCDE) method in a compensatory neuro-fuzzy controller (CNFC). The CNFC model employs compensatory fuzzy operations, which increase the adaptability and effectiveness of the controller. The R-CCDE method was used to determine an adequate control policy for nonlinear system problems. The evolution of a population involved the use of DE with cooperative coevolution to adjust CNFC parameters, and the fitness function of the R-CCDE method is used by a reinforcement signal to determine the controller that can be used to solve the control problem. This paper identified the best performing controller to solve nonlinear system problems. The simulation results of the proposed R-CCDE method were compared with those of various DE methods and the performance of the proposed R-CCDE method was superior to that of the other methods.
引用
收藏
页码:4719 / 4729
页数:11
相关论文
共 49 条
[1]   Natural encoding for evolutionary supervised learning [J].
Aguilar-Ruiz, Jesus S. ;
Giraldez, Raul ;
Riquelme, Jose C. .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2007, 11 (04) :466-479
[2]   An approach to Online identification of Takagi-Suigeno fuzzy models [J].
Angelov, PP ;
Filev, DP .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2004, 34 (01) :484-498
[3]  
[Anonymous], P 17 IFAC WORLD C SE
[4]   An efficient parameterization of dynamic neural networks for nonlinear system identification [J].
Becerra, VM ;
Garces, FR ;
Nasuto, SJ ;
Holderbaum, W .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2005, 16 (04) :983-988
[5]   Application of differential evolution algorithm for transient stability constrained optimal power flow [J].
Cai, H. R. ;
Chung, C. Y. ;
Wong, K. P. .
IEEE TRANSACTIONS ON POWER SYSTEMS, 2008, 23 (02) :719-728
[6]   Supervised learning of semantic classes for image annotation and retrieval [J].
Carneiro, Gustavo ;
Chan, Antoni B. ;
Moreno, Pedro J. ;
Vasconcelos, Nuno .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (03) :394-410
[7]  
Cheng-Jian Lin, 2002, Journal of the Chinese Institute of Electrical Engineering, V9, P11
[8]   An approach to tune fuzzy controllers based on reinforcement learning for autonomous vehicle control [J].
Dai, X ;
Li, CK ;
Rad, AB .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2005, 6 (03) :285-293
[9]   Deep Direct Reinforcement Learning for Financial Signal Representation and Trading [J].
Deng, Yue ;
Bao, Feng ;
Kong, Youyong ;
Ren, Zhiquan ;
Dai, Qionghai .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (03) :653-664
[10]   Complexity versus integrity solution in adaptive fuzzy-neural inference models [J].
Dimirovski, Georgi M. .
INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2008, 23 (05) :556-573