FLTRNN: Faithful Long-Horizon Task Planning for Robotics with Large Language Models

被引:2
作者
Zhang, Jiatao [1 ,2 ]
Tang, Lanling [2 ,3 ]
Song, Yufan [1 ]
Menge, Qiwei [2 ]
Qian, Haofu [1 ,2 ]
Shao, Jun [1 ,2 ]
Song, Wei [1 ,2 ]
Zhu, Shiqiang [1 ]
Gu, Jason [2 ]
机构
[1] Zhejiang Univ, Hangzhou, Peoples R China
[2] Zhejiang Lab, Res Ctr Intelligent Robot, Hangzhou, Peoples R China
[3] Univ Chinese Acad Sci, Beijing, Peoples R China
来源
2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA 2024 | 2024年
基金
中国国家自然科学基金;
关键词
D O I
10.1109/ICRA57147.2024.10611663
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent planning methods based on Large Language Models typically employ the In-Context Learning paradigm. Complex long-horizon planning tasks require more context(including instructions and demonstrations) to guarantee that the generated plan can be executed correctly. However, in such conditions, LLMs may overlook(unfaithful) the rules in the given context, resulting in the generated plans being invalid or even leading to dangerous actions. In this paper, we investigate the faithfulness of LLMs for complex long-horizon tasks. Inspired by human intelligence, we introduce a novel framework named FLTRNN. FLTRNN employs a language-based RNN structure to integrate task decomposition and memory management into LLM planning inference, which could effectively improve the faithfulness of LLMs and make the planner more reliable. We conducted experiments in VirtualHome household tasks. Results show that our model significantly improves faithfulness and success rates for complex long-horizon tasks. Website at https://tannl.github.io/FLTRNN.github.io/
引用
收藏
页码:6680 / 6686
页数:7
相关论文
共 50 条
  • [41] State-Dependent Maximum Entropy Reinforcement Learning for Robot Long-Horizon Task Learning
    Deshuai Zheng
    Jin Yan
    Tao Xue
    Yong Liu
    [J]. Journal of Intelligent & Robotic Systems, 2024, 110
  • [42] Are self-explanations from Large Language Models faithful?
    Madsen, Andreas
    Chandar, Sarath
    Reddy, Siva
    [J]. FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: ACL 2024, 2024, : 295 - 337
  • [43] RRT*-enhanced long-horizon path planning for AUV adaptive sampling using a cost valley
    Ge, Yaolin
    Eidsvik, Jo
    Olaisen, Andre Julius Hovd
    [J]. KNOWLEDGE-BASED SYSTEMS, 2025, 315
  • [44] ERRA: An Embodied Representation and Reasoning Architecture for Long-Horizon Language-Conditioned Manipulation Tasks
    Zhao, Chao
    Yuan, Shuai
    Jiang, Chunli
    Cai, Junhao
    Yu, Hongyu
    Wang, Michael Yu
    Chen, Qifeng
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (06) : 3230 - 3237
  • [45] CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks
    Mees, Oier
    Hermann, Lukas
    Rosete-Beas, Erick
    Burgard, Wolfram Burgard
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (03): : 7327 - 7334
  • [46] Large language models for robotics: Opportunities, challenges, and perspectives
    Jiaqi Wang
    Enze Shi
    Huawen Hu
    Chong Ma
    Yiheng Liu
    Xuhui Wang
    Yincheng Yao
    Xuan Liu
    Bao Ge
    Shu Zhang
    [J]. Journal of Automation and Intelligence, 2025, 4 (01) : 52 - 64
  • [47] SC-AIRL: Share-Critic in Adversarial Inverse Reinforcement Learning for Long-Horizon Task
    Xiang, Guangyu
    Li, Shaodong
    Shuang, Feng
    Gao, Fang
    Yuan, Xiaogang
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (04) : 3179 - 3186
  • [48] PROGPROMPT: program generation for situated robot task planning using large language models
    Singh, Ishika
    Blukis, Valts
    Mousavian, Arsalan
    Goyal, Ankit
    Xu, Danfei
    Tremblay, Jonathan
    Fox, Dieter
    Thomason, Jesse
    Garg, Animesh
    [J]. AUTONOMOUS ROBOTS, 2023, 47 (08) : 999 - 1012
  • [49] Action Contextualization: Adaptive Task Planning and Action Tuning Using Large Language Models
    Gupta, Sthithpragya
    Yao, Kunpeng
    Niederhauser, Loic
    Billard, Aude
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (11): : 9407 - 9414
  • [50] ProgPrompt: program generation for situated robot task planning using large language models
    Ishika Singh
    Valts Blukis
    Arsalan Mousavian
    Ankit Goyal
    Danfei Xu
    Jonathan Tremblay
    Dieter Fox
    Jesse Thomason
    Animesh Garg
    [J]. Autonomous Robots, 2023, 47 : 999 - 1012