Sim2Real Neural Controllers for Physics-Based Robotic Deployment of Deformable Linear Objects

被引:5
|
作者
Tong, Dezhong [1 ]
Choi, Andrew [2 ]
Qin, Longhui [1 ,3 ]
Huang, Weicheng [1 ,3 ]
Joo, Jungseock [4 ,5 ]
Jawed, Mohammad Khalid [1 ,6 ]
机构
[1] Univ Calif Los Angeles, Dept Mech & Aerosp Engn, Los Angeles, CA USA
[2] Univ Calif Los Angeles, Dept Comp Sci, Los Angeles, CA USA
[3] Southeast Univ, Sch Mech Engn, Nanjing, Peoples R China
[4] Univ Calif Los Angeles, Dept Commun, Los Angeles, CA USA
[5] NVIDIA Corp, Santa Clara, CA USA
[6] Univ Calif Los Angeles, Dept Mech & Aerosp Engn, 420 Westwood Plaza, Los Angeles, CA 90095 USA
基金
美国国家科学基金会;
关键词
Deformable object manipulation; data-driven models; deep neural networks; rope deployment; knots; ELASTIC RODS; MANIPULATION; CABLE; MODEL;
D O I
10.1177/02783649231214553
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Deformable linear objects (DLOs), such as rods, cables, and ropes, play important roles in daily life. However, manipulation of DLOs is challenging as large geometrically nonlinear deformations may occur during the manipulation process. This problem is made even more difficult as the different deformation modes (e.g., stretching, bending, and twisting) may result in elastic instabilities during manipulation. In this paper, we formulate a physics-guided data-driven method to solve a challenging manipulation task-accurately deploying a DLO (an elastic rod) onto a rigid substrate along various prescribed patterns. Our framework combines machine learning, scaling analysis, and physical simulations to develop a physics-based neural controller for deployment. We explore the complex interplay between the gravitational and elastic energies of the manipulated DLO and obtain a control method for DLO deployment that is robust against friction and material properties. Out of the numerous geometrical and material properties of the rod and substrate, we show that only three non-dimensional parameters are needed to describe the deployment process with physical analysis. Therefore, the essence of the controlling law for the manipulation task can be constructed with a low-dimensional model, drastically increasing the computation speed. The effectiveness of our optimal control scheme is shown through a comprehensive robotic case study comparing against a heuristic control method for deploying rods for a wide variety of patterns. In addition to this, we also showcase the practicality of our control scheme by having a robot accomplish challenging high-level tasks such as mimicking human handwriting, cable placement, and tying knots.
引用
收藏
页码:791 / 810
页数:20
相关论文
共 8 条
  • [1] Learning Neural Force Manifolds for Sim2Real Robotic Symmetrical Paper Folding
    Choi, Andrew
    Tong, Dezhong
    Terzopoulos, Demetri
    Joo, Jungseock
    Jawed, Mohammad Khalid
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 : 1483 - 1496
  • [2] Learning Neural Force Manifolds for Sim2Real Robotic Symmetrical Paper Folding
    Choi, Andrew
    Tong, Dezhong
    Terzopoulos, Demetri
    Joo, Jungseock
    Jawed, Mohammad Khalid
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 : 1483 - 1496
  • [3] Multimodality Driven Impedance-Based Sim2Real Transfer Learning for Robotic Multiple Peg-in-Hole Assembly
    Chen, Wenkai
    Zeng, Chao
    Liang, Hongzhuo
    Sun, Fuchun
    Zhang, Jianwei
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (05) : 2784 - 2797
  • [4] DefGraspSim: Physics-Based Simulation of Grasp Outcomes for 3D Deformable Objects
    Huang, Isabella
    Narang, Yashraj
    Eppner, Clemens
    Sundaralingam, Balakumar
    Macklin, Miles
    Bajcsy, Ruzena
    Hermans, Tucker
    Fox, Dieter
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (03) : 6274 - 6281
  • [5] Vision-based DRL Autonomous Driving Agent with Sim2Real Transfer
    Li, Dianzhao
    Okhrin, Ostap
    2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC, 2023, : 866 - 873
  • [6] Optimal model-based path planning for the robotic manipulation of deformable linear objects
    Monguzzi, Andrea
    Dotti, Tommaso
    Fattorelli, Lorenzo
    Zanchettin, Andrea Maria
    Rocco, Paolo
    ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2025, 92
  • [7] Unraveling of deformable linear objects based on 2D information about their crossing states
    Wakamatsu, Hidefumi
    Tsumaya, Akira
    Arai, Eiji
    Hirai, Shinichi
    2006 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, VOLS 1-12, 2006, : 3873 - +
  • [8] Physics-Based Deep Neural Network for Real-Time Lesion Tracking in Ultrasound-Guided Breast Biopsy
    Mendizabal, Andrea
    Tagliabue, Eleonora
    Brunet, Jean-Nicolas
    Dall'Alba, Diego
    Fiorini, Paolo
    Cotin, Stephane
    COMPUTATIONAL BIOMECHANICS FOR MEDICINE, 2020, : 33 - 45