Active Steering Control of Independently Rotating Wheels Based on Multi-agent Deep Reinforcement Learning with Experimental Validation

被引:0
作者
Wei, Juyao [1 ]
Lu, Zhenggang [1 ]
Yong, Xinjian [1 ]
Wang, Zehan [1 ]
机构
[1] Tongji Univ, Inst Rail Transit, Shanghai, Peoples R China
来源
ADVANCES IN DYNAMICS OF VEHICLES ON ROADS AND TRACKS III, VOL 1, IAVSD 2023 | 2025年
关键词
Active steering; Independently rotating wheels (IRW); Multi-agent deep deterministic policy gradient (MADDPG); Multi-agent reinforcement learning (MARL); Scaled model; GUIDANCE;
D O I
10.1007/978-3-031-66971-2_72
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This research introduces a control algorithm based on multi-agent reinforcement learning (MARL) designed to enhance the running performance of independently rotating wheels (IRW). The algorithm's effectiveness is experimentally validated using a 1:5 scale model. For this purpose, we constructed a dynamic simulation model of the scaled prototype and developed a training loop for a model-free controller. The front and rear wheelsets are considered individual agents, and the multi-agent deep deterministic policy gradient (MADDPG) algorithm is applied to realize distributed steering control. The proposed controller is implemented on an embedded computer within the scaled vehicle on a scaled experimental track, where the lateral displacement and attack angle of the wheelset are calculated through 3D laser profiler sensors. The experimental results show that the steering performance of IRWs on both straight and curved tracks is significantly improved when using the MADDPG controller.
引用
收藏
页码:689 / 700
页数:12
相关论文
共 11 条
[1]   Control of the Lateral Displacement Restoring Force of IRWs for Sharp Curved Driving [J].
Ahn, Hanwoong ;
Lee, Hyungwoo ;
Go, Sungchul ;
Cho, Yonho ;
Lee, Ju .
JOURNAL OF ELECTRICAL ENGINEERING & TECHNOLOGY, 2016, 11 (04) :1042-1048
[2]   Mechatronic track guidance on disturbed track: the trade-off between actuator performance and wheel wear [J].
Kurzeck, Bernhard ;
Heckmann, Andreas ;
Wesseler, Christoph ;
Rapp, Matthias .
VEHICLE SYSTEM DYNAMICS, 2014, 52 :109-124
[3]   Active control of independently-rotating wheels with gyroscopes and tachometers - simple solutions for perfect curving and high stability performance [J].
Liu, Xiaoyuan ;
Goodall, Roger ;
Iwnicki, Simon .
VEHICLE SYSTEM DYNAMICS, 2021, 59 (11) :1719-1734
[4]  
Lowe R, 2017, ADV NEUR IN, V30
[5]   Robust active guidance control using the μ-synthesis method for a tramcar with independently rotating wheelsets [J].
Lu, Zheng-Gang ;
Yang, Zhe ;
Huang, Qi ;
Wang, Xiao-Chao .
PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART F-JOURNAL OF RAIL AND RAPID TRANSIT, 2019, 233 (01) :33-48
[6]   Integrated active control of independently rotating wheels on rail vehicles via observers [J].
Lu, Zheng-Gang ;
Sun, Xiao-Jie ;
Yang, Jun-Qi .
PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART F-JOURNAL OF RAIL AND RAPID TRANSIT, 2017, 231 (03) :295-305
[7]   Active Steering Controller for Driven Independently Rotating Wheelset Vehicles Based on Deep Reinforcement Learning [J].
Lu, Zhenggang ;
Wei, Juyao ;
Wang, Zehan .
PROCESSES, 2023, 11 (09)
[8]  
Moritz P, 2018, PROCEEDINGS OF THE 13TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P561
[9]  
Sutton RS, 2018, ADAPT COMPUT MACH LE, P1
[10]  
Taylor ME, 2006, GECCO 2006: GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, VOL 1 AND 2, P1321