Multi-Modal and Adaptive Robot Control through Hierarchical Quadratic Programming

被引:0
|
作者
Tassi, Francesco [1 ]
Ajoudani, Arash [1 ]
机构
[1] Ist Italiano Tecnol, Human Robot Interfaces & Interact Lab, Genoa, Italy
基金
欧洲研究理事会;
关键词
Hierarchical optimal control; Adaptive compliance; Human-robot collaboration; Variable impedance control; Force control; MULTIROBOT; MOTION; BEHAVIOR;
D O I
10.1007/s10846-024-02193-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a novel Hierarchical Quadratic Programming (HQP)-based framework that enables multi-tasking control under multiple Human-Robot Interaction (HRI) scenarios. The proposed controllers' formulations are inspired by real-world contact-rich scenarios, which currently constitute one of the main limitations in terms of widespread practical deployment. Indeed, HRI can occur through different modalities, based on human's needs. The objective is to create a unique framework for various types of possible interactions, avoiding the necessity of switching between different control architectures, which requires dealing with discontinuities. To achieve this, we firstly propose a HQP-based hybrid Cartesian/joint space impedance control formulation. Based on the robot's dynamics, this controller enables an adaptive compliance behaviour, while achieving hierarchical motion control. This is validated through a series of experiments that show the accuracy of trajectory tracking, which remains in the order of 10mm during fast motions thanks to the addition of the robot dynamics. Besides, the hybrid compliance behaviour allows to deviate from such accuracy when an interaction is present. We then consider the case in which the human needs to move the robot directly, by proposing a hybrid admittance/impedance controller, that is again based on a HQP formulation and provides inherent softening when conflicting tasks are present, or in close-to-limit and near-singular configurationsa. This is validated through several experiments in which the human easily moves the robot in the workspace via direct physical interaction. Next, we formulate an additional hierarchy that enables force control and allows to maintain a specific interaction force at the end effector. We then extend this to simultaneous force and trajectory tracking. Overall, we obtain a multi-purpose HQP-based control framework, that seamlessly switchwes between interaction modes, enabling multiple hierarchical behaviours, and covering a wide spectrum of interaction types, essential for synergistic HRI.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] Multi-modal Authentication Using Continuous Dynamic Programming
    Radhika, K. R.
    Sheela, S. V.
    Venkatesha, M. K.
    Sekhar, G. N.
    BIOMETRIC ID MANAGEMENT AND MULTIMODAL COMMUNICATION, PROCEEDINGS, 2009, 5707 : 228 - +
  • [42] Hierarchical multi-modal video summarization with dynamic sampling
    Yu, Lingjian
    Zhao, Xing
    Xie, Liang
    Liang, Haoran
    Liang, Ronghua
    IET IMAGE PROCESSING, 2024, 18 (14) : 4577 - 4588
  • [43] Multi-modal control of systems with constraints
    Koo, TJ
    Pappas, GJ
    Sastry, S
    PROCEEDINGS OF THE 40TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-5, 2001, : 2075 - 2080
  • [44] The Research of Multi-modal Control Strategy
    Zhang, Tongjie
    Hou, Yuanlong
    Gao, Qiang
    Hou, Runmin
    Min, Hao
    Jia, Litong
    2016 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT HUMAN-MACHINE SYSTEMS AND CYBERNETICS (IHMSC), VOL. 1, 2016, : 577 - 581
  • [45] Learning multi-modal control programs
    Mehta, TR
    Egerstedt, M
    HYBRID SYSTEMS: COMPUTATION AND CONTROL, 2005, 3414 : 466 - 479
  • [46] Multi-modal interaction for UAS control
    Taylor, Glenn
    Purman, Ben
    Schermerhorn, Paul
    Garcia-Sampedro, Guillermo
    Hubal, Robert
    Crabtree, Kathleen
    Rowe, Allen
    Spriggs, Sarah
    UNMANNED SYSTEMS TECHNOLOGY XVII, 2015, 9468
  • [47] Landmark Classification With Hierarchical Multi-Modal Exemplar Feature
    Zhu, Lei
    Shen, Jialie
    Jin, Hai
    Xie, Liang
    Zheng, Ran
    IEEE TRANSACTIONS ON MULTIMEDIA, 2015, 17 (07) : 981 - 993
  • [48] A Stumble Detection Method for Programming with Multi-modal Information
    Oka, Hiroki
    Ohnishi, Ayumi
    Terada, Tsutomu
    Tsukamoto, Masahiko
    ADVANCES IN MOBILE COMPUTING AND MULTIMEDIA INTELLIGENCE, MOMM 2022, 2022, 13634 : 169 - 174
  • [49] A Modular Approach to Programming Multi-Modal Sensing Applications
    Abdelmoamen, Ahmed
    2018 IEEE INTERNATIONAL CONFERENCE ON COGNITIVE COMPUTING (ICCC), 2018, : 91 - 98
  • [50] Reinforcing robot perception of multi-modal events through repetition and redundancy and repetition and redundancy
    Fitzpatrick, Paul
    Arsenio, Artur
    Torres-Jara, Eduardo R.
    INTERACTION STUDIES, 2006, 7 (02) : 171 - 196