Reinforcement Learning-Based Control for Robotic Flexible Element Disassembly

被引:0
作者
Paz, Benjamin Tapia Sal [1 ,2 ]
Sorrosal, Gorka [1 ]
Mancisidor, Aitziber [2 ]
Calleja, Carlos [1 ]
Cabanes, Itziar [2 ]
机构
[1] Ikerlan Technol Res Ctr, Basque Res & Technol Alliance BRTA, Arrasate Mondragon 20500, Spain
[2] Univ Basque Country UPV EHU, Bilbao Sch Engn, Dept Automat Control & Syst Engn, Bilbao 48013, Spain
基金
欧盟地平线“2020”;
关键词
intelligent control; robotic control; decision-making; reinforcement learning (RL); robotic disassembly;
D O I
10.3390/math13071120
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Disassembly plays a vital role in sustainable manufacturing and recycling processes, facilitating the recovery and reuse of valuable components. However, automating disassembly, especially for flexible elements such as cables and rubber seals, poses significant challenges due to their nonlinear behavior and dynamic properties. Traditional control systems struggle to handle these tasks efficiently, requiring adaptable solutions that can operate in unstructured environments that provide online adaptation. This paper presents a reinforcement learning (RL)-based control strategy for the robotic disassembly of flexible elements. The proposed method focuses on low-level control, in which the precise manipulation of the robot is essential to minimize force and avoid damage during extraction. An adaptive reward function is tailored to account for varying material properties, ensuring robust performance across different operational scenarios. The RL-based approach is evaluated in a simulation using soft actor-critic (SAC), deep deterministic policy gradient (DDPG), and proximal policy optimization (PPO) algorithms, benchmarking their effectiveness in dynamic environments. The experimental results indicate the satisfactory performance of the robot under operational conditions, achieving an adequate success rate and force minimization. Notably, there is at least a 20% reduction in force compared to traditional planning methods. The adaptive reward function further enhances the ability of the robotic system to generalize across a range of flexible element disassembly tasks, making it a promising solution for real-world applications.
引用
收藏
页数:21
相关论文
共 33 条
[1]   Optuna: A Next-generation Hyperparameter Optimization Framework [J].
Akiba, Takuya ;
Sano, Shotaro ;
Yanase, Toshihiko ;
Ohta, Takeru ;
Koyama, Masanori .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :2623-2631
[2]   Learning Force Control for Contact-Rich Manipulation Tasks With Rigid Position-Controlled Robots [J].
Beltran-Hernandez, Cristian Camilo ;
Petit, Damien ;
Ramirez-Alpizar, Ixchel Georgina ;
Nishi, Takayuki ;
Kikuchi, Shinichi ;
Matsubara, Takamitsu ;
Harada, Kensuke .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (04) :5709-5716
[3]  
Chebotar Y., 2018, P 2017 IEEE INT C RO
[4]   Robotic assembly automation using robust compliant control [J].
Chen, Heping ;
Liu, Yong .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2013, 29 (02) :293-300
[5]   Adaptive variable impedance control for dynamic contact force tracking in uncertain environment [J].
Duan Jinjun ;
Gan Yahui ;
Chen Ming ;
Dai Xianzhong .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2018, 102 :54-65
[6]  
Duan Y, 2016, PR MACH LEARN RES, V48
[7]   A review on reinforcement learning for contact-rich robotic manipulation tasks [J].
Elguea-Aguinaco, Inigo ;
Serrano-Munoz, Antonio ;
Chrysostomou, Dimitrios ;
Inziarte-Hidalgo, Ibai ;
Bogh, Simon ;
Arana-Arexolaleiba, Nestor .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2023, 81
[8]   Learning manipulation skills from a single demonstration [J].
Englert, Peter ;
Toussaint, Marc .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2018, 37 (01) :137-154
[9]  
Foo Gwendolyn, 2022, Procedia CIRP, P513, DOI 10.1016/j.procir.2022.02.085
[10]   Human-robot collaboration in industrial environments: A literature review on non-destructive disassembly* [J].
Hjorth, Sebastian ;
Chrysostomou, Dimitrios .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2022, 73