FLTRNN: Faithful Long-Horizon Task Planning for Robotics with Large Language Models

被引:2
作者
Zhang, Jiatao [1 ,2 ]
Tang, Lanling [2 ,3 ]
Song, Yufan [1 ]
Menge, Qiwei [2 ]
Qian, Haofu [1 ,2 ]
Shao, Jun [1 ,2 ]
Song, Wei [1 ,2 ]
Zhu, Shiqiang [1 ]
Gu, Jason [2 ]
机构
[1] Zhejiang Univ, Hangzhou, Peoples R China
[2] Zhejiang Lab, Res Ctr Intelligent Robot, Hangzhou, Peoples R China
[3] Univ Chinese Acad Sci, Beijing, Peoples R China
来源
2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2024 | 2024年
基金
中国国家自然科学基金;
关键词
D O I
10.1109/ICRA57147.2024.10611663
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent planning methods based on Large Language Models typically employ the In-Context Learning paradigm. Complex long-horizon planning tasks require more context(including instructions and demonstrations) to guarantee that the generated plan can be executed correctly. However, in such conditions, LLMs may overlook(unfaithful) the rules in the given context, resulting in the generated plans being invalid or even leading to dangerous actions. In this paper, we investigate the faithfulness of LLMs for complex long-horizon tasks. Inspired by human intelligence, we introduce a novel framework named FLTRNN. FLTRNN employs a language-based RNN structure to integrate task decomposition and memory management into LLM planning inference, which could effectively improve the faithfulness of LLMs and make the planner more reliable. We conducted experiments in VirtualHome household tasks. Results show that our model significantly improves faithfulness and success rates for complex long-horizon tasks. Website at https://tannl.github.io/FLTRNN.github.io/
引用
收藏
页码:6680 / 6686
页数:7
相关论文
共 50 条
  • [31] The finite sample power of long-horizon predictive tests in models with financial bubbles
    Maynard, Alex
    Ren, Dongmeng
    INTERNATIONAL REVIEW OF FINANCIAL ANALYSIS, 2019, 63 : 418 - 430
  • [32] Value-Based Subgoal Discovery and Path Planning for Reaching Long-Horizon Goals
    Pateria, Shubham
    Subagdja, Budhitama
    Tan, Ah-Hwee
    Quek, Chai
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (08) : 10288 - 10300
  • [33] Accelerating Long-Horizon Planning with Affordance-Directed Dynamic Grounding of Abstract Strategies
    Elimelech, Khen
    Kingston, Zachary
    Thomason, Wil
    Vardi, Moshe Y.
    Kavraki, Lydia E.
    2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2024), 2024, : 12688 - 12695
  • [34] Long-Horizon Motion Planning for Autonomous Vehicle Parking Incorporating Incomplete Map Information
    Dai, Siyu
    Wang, Yebin
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 8135 - 8142
  • [35] ASSESSING THE POWER OF LONG-HORIZON PREDICTIVE TESTS IN MODELS OF BULL AND BEAR MARKETS
    Maynard, Alex
    Ren, Dongmeng
    ESSAYS IN HONOR OF PETER C. B. PHILLIPS, 2014, 33 : 673 - 711
  • [36] Long-Horizon Vehicle Motion Planning and Control Through Serially Cascaded Model Complexity
    Laurense, Vincent A.
    Gerdes, J. Christian
    IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2022, 30 (01) : 166 - 179
  • [37] Long-horizon Robotic Search and Classification using Sampling-based Motion Planning
    Hollinger, Geoffrey A.
    ROBOTICS: SCIENCE AND SYSTEMS XI, 2015,
  • [38] TPML: Task Planning for Multi-UAV System with Large Language Models
    Cui, Jinqiang
    Liu, Guocai
    Wang, Hui
    Yu, Yue
    Yang, Jiankun
    2024 IEEE 18TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION, ICCA 2024, 2024, : 886 - 891
  • [39] Intrinsic Language-Guided Exploration for Complex Long-Horizon Robotic Manipulation Tasks
    Triantafyllidis, Eleftherios
    Christianos, Filippos
    Li, Zhibin
    2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2024, 2024, : 7493 - 7500
  • [40] State-Dependent Maximum Entropy Reinforcement Learning for Robot Long-Horizon Task Learning
    Zheng, Deshuai
    Yan, Jin
    Xue, Tao
    Liu, Yong
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2024, 110 (01)