Driver Behavior Modeling via Inverse Reinforcement Learning Based on Particle Swarm Optimization

被引:1
|
作者
Liu, Zeng-Jie [1 ]
Wu, Huai-Ning [1 ]
机构
[1] Beihang Univ, Sch Automat Sci & Elect Engn, Sci & Technol Aircraft Control Lab, Beijing 100191, Peoples R China
来源
2020 CHINESE AUTOMATION CONGRESS (CAC 2020) | 2020年
关键词
Driver behavior modeling; T-S fuzzy model; inverse reinforcement learning; particle swarm optimization;
D O I
10.1109/CAC51589.2020.9327174
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, an inverse reinforcement learning method based on particle swarm optimization (PSO) is proposed to model driver's steering behavior. Initially, the vehicle dynamics is represented by a Takagi-Sugeno (T-S) fuzzy model which provides a method of approximating Q-function. Then the driver behavior model is described as an optimal control policy with decision-making model which illustrates the driving style. Subsequently, the Q-function is approximated by a quadratic polynomial-in-memberships form and the PSO algorithm is used to obtain the decision-making model from the driving data. And the corresponding optimal control policy is obtained by using the Q-learning policy iteration method. Finally, a numerical simulation is carried to show the effectiveness of the proposed method.
引用
收藏
页码:7232 / 7237
页数:6
相关论文
共 50 条
  • [1] Inverse Reinforcement Learning Based Stochastic Driver Behavior Learning
    Ozkan, Mehmet F.
    Rocque, Abishek J.
    Ma, Yao
    IFAC PAPERSONLINE, 2021, 54 (20): : 882 - 888
  • [2] Swarm Reinforcement Learning Algorithms Based on Particle Swarm Optimization
    Iima, Hitoshi
    Kuroe, Yasuaki
    2008 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), VOLS 1-6, 2008, : 1109 - 1114
  • [3] A reinforcement learning-based communication topology in particle swarm optimization
    Xu, Yue
    Pi, Dechang
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (14): : 10007 - 10032
  • [4] A reinforcement learning-based communication topology in particle swarm optimization
    Yue Xu
    Dechang Pi
    Neural Computing and Applications, 2020, 32 : 10007 - 10032
  • [5] Reinforcement-learning-based parameter adaptation method for particle swarm optimization
    Yin, Shiyuan
    Jin, Min
    Lu, Huaxiang
    Gong, Guoliang
    Mao, Wenyu
    Chen, Gang
    Li, Wenchang
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (05) : 5585 - 5609
  • [6] Reinforcement-learning-based parameter adaptation method for particle swarm optimization
    Shiyuan Yin
    Min Jin
    Huaxiang Lu
    Guoliang Gong
    Wenyu Mao
    Gang Chen
    Wenchang Li
    Complex & Intelligent Systems, 2023, 9 : 5585 - 5609
  • [7] Pixel-based mask optimization via particle swarm optimization algorithm for inverse lithography
    Wang, Lei
    Li, Sikun
    Wang, Xiangzhao
    Yang, Chaoxing
    Tang, Feng
    OPTICAL MICROLITHOGRAPHY XXIX, 2016, 9780
  • [8] Swarm Reinforcement Learning Algorithm Based on Particle Swarm Optimization Whose Personal Bests Have Lifespans
    Iima, Hitoshi
    Kuroe, Yasuaki
    NEURAL INFORMATION PROCESSING, PT 2, PROCEEDINGS, 2009, 5864 : 169 - 178
  • [9] Integrating Particle Swarm Optimization with Reinforcement Learning in Noisy Problems
    Piperagkas, Grigoris S.
    Georgoulas, George
    Parsopoulos, Kostas E.
    Stylios, Chrysostomos D.
    Likas, Aristidis C.
    PROCEEDINGS OF THE FOURTEENTH INTERNATIONAL CONFERENCE ON GENETIC AND EVOLUTIONARY COMPUTATION CONFERENCE, 2012, : 65 - 72
  • [10] Reinforcement learning-based particle swarm optimization with neighborhood differential mutation strategy
    Li, Wei
    Liang, Peng
    Sun, Bo
    Sun, Yafeng
    Huang, Ying
    SWARM AND EVOLUTIONARY COMPUTATION, 2023, 78