Research and implementation of variable-domain fuzzy PID intelligent control method based on Q-Learning for self-driving in complex scenarios

被引:11
作者
Yao, Yongqiang [1 ]
Ma, Nan [2 ]
Wang, Cheng [1 ]
Wu, Zhixuan [1 ]
Xu, Cheng [1 ]
Zhang, Jin [1 ]
机构
[1] Beijing Union Univ, Beijing Key Lab Informat Serv Engn, Beijing 100101, Peoples R China
[2] Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
基金
北京市自然科学基金; 中国国家自然科学基金;
关键词
self-driving; intelligent control; Q-Learning; variable-domain fuzzy PID; SYSTEM; DESIGN;
D O I
10.3934/mbe.2023260
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
In the control of the self-driving vehicles, PID controllers are widely used due to their simple structure and good stability. However, in complex self-driving scenarios such as curvature curves, car following, overtaking, etc., it is necessary to ensure the stable control accuracy of the vehicles. Some researchers used fuzzy PID to dynamically change the parameters of PID to ensure that the vehicle control remains in a stable state. It is difficult to ensure the control effect of the fuzzy controller when the size of the domain is not selected properly. This paper designs a variable -domain fuzzy PID intelligent control method based on Q-Learning to make the system robust and adaptable, which is dynamically changed the size of the domain to further ensure the control effect of the vehicle. The variable-domain fuzzy PID algorithm based on Q-Learning takes the error and the error rate of change as input and uses the Q-Learning method to learn the scaling factor online so as to achieve online PID parameters adjustment. The proposed method is verified on the Panosim simulation platform.The experiment shows that the accuracy is improved by 15% compared with the traditional fuzzy PID, which reflects the effectiveness of the algorithm.
引用
收藏
页码:6016 / 6029
页数:14
相关论文
共 34 条
[1]   Control of a Point Absorber Using Reinforcement Learning [J].
Anderlini, Enrico ;
Forehand, David I. M. ;
Stansell, Paul ;
Xiao, Qing ;
Abusara, Mohammad .
IEEE TRANSACTIONS ON SUSTAINABLE ENERGY, 2016, 7 (04) :1681-1690
[2]  
[Anonymous], 2016, ADV SCI TECHNOL LETT, DOI DOI 10.14257/ASTL.2016.138.37
[3]  
Bala Subramanyam P.N.V., 2019, International Journal of Mechanical and Production Engineering Research and Development, V9, P737, DOI [10.24247/ijmperdoct201834, DOI 10.24247/IJMPERDOCT201834]
[4]   Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learning [J].
Brunke, Lukas ;
Greeff, Melissa ;
Hall, Adam W. ;
Yuan, Zhaocong ;
Zhou, Siqi ;
Panerati, Jacopo ;
Schoellig, Angela P. .
ANNUAL REVIEW OF CONTROL ROBOTICS AND AUTONOMOUS SYSTEMS, 2022, 5 :411-444
[5]   The effect of fuzzy PID temperature control on thermal behavior analysis and kinetics study of biomass microwave pyrolysis [J].
Bu, Quan ;
Cai, Jin ;
Liu, Yuanyuan ;
Cao, Mengjie ;
Dong, Lili ;
Ruan, Roger ;
Mao, Hanping .
JOURNAL OF ANALYTICAL AND APPLIED PYROLYSIS, 2021, 158
[6]   Confidence-Aware Reinforcement Learning for Self-Driving Cars [J].
Cao, Zhong ;
Xu, Shaobing ;
Peng, Huei ;
Yang, Diange ;
Zidek, Robert .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) :7419-7430
[7]  
Diab M.K., 2020, 2020 ADV SCI ENG TEC, P1, DOI DOI 10.1109/ASET48392.2020.9118234
[8]   Reinforcement learning approach to autonomous PID tuning [J].
Dogru, Oguzhan ;
Velswamy, Kirubakaran ;
Ibrahim, Fadi ;
Wu, Yuqi ;
Sundaramoorthy, Arun Senthil ;
Huang, Biao ;
Xu, Shu ;
Nixon, Mark ;
Bell, Noel .
COMPUTERS & CHEMICAL ENGINEERING, 2022, 161
[9]   Optimal Design and Simulation for PID Controller Using Fractional-Order Fish Migration Optimization Algorithm [J].
Guo, Baoyong ;
Zhuang, Zhongjie ;
Pan, Jeng-Shyang ;
Chu, Shu-Chuan .
IEEE ACCESS, 2021, 9 :8808-8819
[10]   Research on Temperature Control of Fuel-Cell Cooling System Based on Variable Domain Fuzzy PID [J].
Jia, Yuru ;
Zhang, Ruiliang ;
Lv, Xue ;
Zhang, Tao ;
Fan, Zhengwu .
PROCESSES, 2022, 10 (03)