Ramp Metering Based on On-line ADHDP (λ) Controller

被引：5

作者：

Bai, Xuerui ^{[1
]}

Zhao, Dongbin ^{[1
]}

Yi, Jianqiang ^{[1
]}

Xu, Jing ^{[1
]}

机构：

[1] Chinese Acad Sci, Inst Automat, Lab Complex Syst & Intelligence Sci, Beijing 100080, Peoples R China

来源：

2008 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-8 | 2008年

关键词：

D O I：

10.1109/IJCNN.2008.4634049

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Increasing dependence on car-based travel has led to the daily occurrence of freeway congestions around the world. In order to improve the worse and worse traffic congestion situation and solve the problems brought with it, a new kind of effective, fast, and robust method should be presented. Ramp metering has been developed as a traffic management strategy to alleviate congestion on freeways. But, it doesn't work well in uncertainty situations. In this paper, in order to solve the problems in uncertainty conditions, an on-tine learning control method based on the fundamental principle of reinforcement learning is proposed. The method is ADP (adaptive dynamic programming) and in order to expedite the learning rate, the concept about eligibility traces is introduced here. Then eligibility trace and ADP is combined to present a new kind of traffic responsive control method. The new method is called action-dependent heuristic dynamic programming based on eligibility traces (ADRDP (lambda)). ADHDP (lambda) is an approximate optimal ramp metering method. Simulation studies on a hypothetical freeway indicate good control performance of the proposed real-time traffic controller.

引用

页码：1847 / 1852

页数：6

共 17 条

[11]

Si J., 2001, IEEE T NEURAL NETWOR, V12

[12]

Sutton R. S., 1998, Reinforcement Learning: An Introduction, V22447

[13]

Werbos P., 1992, Approximate Dynamic Programming for Realtime Control and Neural Modelling

[14] CONSISTENCY OF HDP APPLIED TO A SIMPLE REINFORCEMENT LEARNING-PROBLEM [J].