Artificial intelligence-based position control: reinforcement learning approach in spring mass damper systems

被引:4
作者
Demircioglu, Ufuk [1 ]
Bakir, Halit [2 ]
机构
[1] Sivas Univ Sci & Technol, Fac Engn & Nat Sci, Dept Mech Engn, Sivas, Turkiye
[2] Sivas Univ Sci & Technol, Fac Engn & Nat Sci, Dept Comp Engn, Sivas, Turkiye
关键词
Reinforcement learning;
D O I
10.1088/1402-4896/ad2e57
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
This work examines the use of deep Reinforcement Learning (RL) in mass-spring system position control, providing a fresh viewpoint that goes beyond conventional control techniques. Mass-spring systems are widely used in many sectors and are basic models in control theory. The novel aspect of this approach is the thorough examination of the impact of several optimizer algorithms on the RL methodology, which reveals the optimal control tactics. The research applies a Deep Deterministic Policy Gradient (DDPG) algorithm for continuous action spaces, where the actor and critic networks are important components in assessing the agent's performance. The RL agent is trained to follow a reference trajectory using the Simulink environment for system modeling. The study provides insights into the agent's learning approach and performance optimization by evaluating the training process using force-time graphs, reward graphs, and Episode Manager charts. Furthermore, the effect of different combinations of optimizers on the control performance of the agent is examined. The outcomes highlight the importance of optimizer selection in the learning process by revealing significant variations in training times. As a result, a better understanding of the relationship between various optimizers and control performance is provided by this study's novel application of reinforcement learning in mass-spring system control. The results raise the possibility of more potent methods for controlling complex systems and add to the expanding field of study at the interface of control theory and deep learning.
引用
收藏
页数:14
相关论文
共 34 条
  • [1] Ahmad H., 2016, P 3 INT C ENG EMERGI
  • [2] Fast terminal sliding mode tracking control of nonlinear uncertain mass-spring system with experimental verifications
    Amirkhani, Saeed
    Mobayen, Saleh
    Iliaee, Nahal
    Boubaker, Olfa
    Hosseinnia, S. Hassan
    [J]. INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2019, 16 (01):
  • [3] Aoki T., 2012, IFAC Proceedings Volumes (IFAC PapersOnline), P42, DOI [10.3182/20120829-3-IT-4022.00021, DOI 10.3182/20120829-3-IT-4022.00021]
  • [4] Badr M F., 2020, International Review of Applied Sciences and Engineering, V11, P181
  • [5] A comprehensive experimental study for analyzing the effects of data augmentation techniques on voice classification
    Bakir, Halit
    cayir, Ayse Nur
    Navruz, Tugba Selcen
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (06) : 17601 - 17628
  • [6] Bakr H., 2022, Uluslararas Sivas Bilim ve Teknoloji niversitesi Dergisi, V1, P17
  • [7] Active vibration control of flexible robots using virtual spring-damper systems
    Bernzen, W
    [J]. JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 1999, 24 (01) : 69 - 88
  • [8] Bowen S L., 2014, Design Of Feedback Control For Active Mass Dampers Of Excited Structures
  • [9] Coman S., 2014, Bulletin of the Transilvania University of Brasov. Engineering Sciences. Series I, V7, P69
  • [10] Demetriou D., 2015, Am J Eng Appl Sci, V8, P620, DOI DOI 10.3844/AJEASSP.2015.620.632