An Intelligent Control Method for Servo Motor Based on Reinforcement Learning

被引:2
作者
Gao, Depeng [1 ]
Wang, Shuai [2 ]
Yang, Yuwei [1 ]
Zhang, Haifei [1 ]
Chen, Hao [1 ]
Mei, Xiangxiang [1 ]
Chen, Shuxi [1 ]
Qiu, Jianlin [1 ]
机构
[1] Nantong Inst Technol, Sch Comp & Informat Engn, Nantong 226001, Peoples R China
[2] Northwestern Polytech Univ, Sch Software, Xian 710000, Peoples R China
关键词
servo motor control; motor state perception; reinforcement learning; intelligent control;
D O I
10.3390/a17010014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Servo motors play an important role in automation equipment and have been used in several manufacturing fields. However, the commonly used control methods need their parameters to be set manually, which is rather difficult, and this means that these methods generally cannot adapt to changes in operation conditions. Therefore, in this study, we propose an intelligent control method for a servo motor based on reinforcement learning and that can train an agent to produce a duty cycle according to the servo error between the current state and the target speed or torque. The proposed method can adjust its control strategy online to reduce the servo error caused by a change in operation conditions. We verify its performance on three different servo motors and control tasks. The experimental results show that the proposed method can achieve smaller servo errors than others in most cases.
引用
收藏
页数:15
相关论文
共 31 条
[1]  
Balakrishna P., 2021, Journal of Open Source Software, V6, P2498
[2]  
Baojun G., 2020, Electromechanics
[3]   Transformer-Based Imitative Reinforcement Learning for Multirobot Path Planning [J].
Chen, Lin ;
Wang, Yaonan ;
Miao, Zhiqiang ;
Mo, Yang ;
Feng, Mingtao ;
Zhou, Zhen ;
Wang, Hesheng .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (10) :10233-10243
[4]   Control Strategy of Speed Servo Systems Based on Deep Reinforcement Learning [J].
Chen, Pengzhan ;
He, Zhiqiang ;
Chen, Chuanxi ;
Xu, Jiahong .
ALGORITHMS, 2018, 11 (05)
[5]   Intelligent PID control of an industrial electro-hydraulic system [J].
Coskun, Mustafa Yavuz ;
Itik, Mehmet .
ISA TRANSACTIONS, 2023, 139 :484-498
[6]  
Fujimoto S, 2018, Arxiv, DOI [arXiv:1802.09477, 10.48550/arXiv.1802.09477]
[7]  
Haarnoja T, 2018, Arxiv, DOI [arXiv:1801.01290, DOI 10.48550/ARXIV.1801.01290]
[8]  
Haarnoja T, 2019, Arxiv, DOI arXiv:1812.05905
[9]  
Hamed R.N., 2023, Appl. Soft Comput, V151, P111153
[10]   Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning With Applications in Autonomous Driving [J].
Hoel, Carl-Johan ;
Wolff, Krister ;
Laine, Leo .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (06) :6030-6041