An approach to tune fuzzy controllers based on reinforcement learning for autonomous vehicle control

被引:81
作者
Dai, X [1 ]
Li, CK
Rad, AB
机构
[1] Rockwell Automat Res Ctr, Shanghai 2002333, Peoples R China
[2] Hong Kong Polytech Univ, Dept Elect & Informat Engn, Kowloon, Hong Kong, Peoples R China
[3] Hong Kong Polytech Univ, Dept Elect Engn, Kowloon, Hong Kong, Peoples R China
关键词
autonomous vehicles; fuzzy controllers; longitudinal control; reinforcement learning;
D O I
10.1109/TITS.2005.853698
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
In this paper, we suggest a new approach for tuning parameters of fuzzy controllers based on reinforcement learning. The architecture of the proposed approach is comprised of a Q estimator network (QEN) and a Takagi-Sugeno-type fuzzy inference system (TSK-FIS). Unlike other fuzzy Q-learning approaches that select an optimal action based on finite discrete actions, the proposed controller obtains the control output directly from TSK-FIS. With the proposed architecture, the learning algorithms for all the parameters of the QEN and the FIS are developed based on the temporal-difference (TD) methods as well as the gradient-descent algorithm. The performance of the proposed design technique is illustrated by simulation studies of a vehicle longitudinal-control system.
引用
收藏
页码:285 / 293
页数:9
相关论文
共 35 条
[1]  
BAIRD LC, 1994, 1994 IEEE INTERNATIONAL CONFERENCE ON NEURAL NETWORKS, VOL 1-7, P2448, DOI 10.1109/ICNN.1994.374604
[2]  
BARID L, 1999, ADV NEURAL INFORMATI, V11
[3]  
BARTO AG, 1987, P IEEE 1 ANN C NEUR, P629
[4]  
BOYAN JA, 1995, ADV NEUROL INFORMATI, V7
[5]   A self-learning fuzzy logic controller using genetic algorithms with reinforcements [J].
Chiang, CK ;
Chung, HY ;
Lin, JJ .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 1997, 5 (03) :460-467
[6]  
CHOI DH, 1996, NEURAL PARALLEL SCI, V4, P367
[7]  
Christopher JohnCornish Hella by Watkins., 1989, Learning from delayed rewards
[8]   A STOCHASTIC REINFORCEMENT LEARNING ALGORITHM FOR LEARNING REAL-VALUED FUNCTIONS [J].
GULLAPALLI, V .
NEURAL NETWORKS, 1990, 3 (06) :671-692
[9]  
HEBERT M, 1997, INTELLIGENT UNMANNED
[10]   Use of neural fuzzy networks with mixed genetic/gradient algorithm in automated vehicle control [J].
Huang, SN ;
Ren, W .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 1999, 46 (06) :1090-1102