A Survey of Embodied AI: From Simulators to Research Tasks

被引:106
|
作者
Duan, Jiafei [1 ]
Yu, Samson [2 ]
Tan, Hui Li [3 ]
Zhu, Hongyuan [3 ]
Tan, Cheston [3 ]
机构
[1] Nanyang Technol Univ Singapore, Sch Elect & Elect Engn, Singapore 639798, Singapore
[2] Singapore Univ Technol & Design, Singapore 487372, Singapore
[3] ASTAR, Inst Infocomm Res, Singapore 138632, Singapore
来源
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE | 2022年 / 6卷 / 02期
基金
新加坡国家研究基金会;
关键词
Artificial intelligence; Task analysis; Navigation; Physics; Three-dimensional displays; Visualization; Solid modeling; Embodied AI; computer vision; 3D simulators; NAVIGATION;
D O I
10.1109/TETCI.2022.3141105
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There has been an emerging paradigm shift from the era of "internet AI" to "embodied AI," where AI algorithms and agents no longer learn from datasets of images, videos or text curated primarily from the internet. Instead, they learn through interactions with their environments from an egocentric perception similar to humans. Consequently, there has been substantial growth in the demand for embodied AI simulators to support various embodied AI research tasks. This growing interest in embodied AI is beneficial to the greater pursuit of Artificial General Intelligence (AGI), but there has not been a contemporary and comprehensive survey of this field. This paper aims to provide an encyclopedic survey for the field of embodied AI, from its simulators to its research. By evaluating nine current embodied AI simulators with our proposed seven features, this paper aims to understand the simulators in their provision for use in embodied AI research and their limitations. Lastly, this paper surveys the three main research tasks in embodied AI - visual exploration, visual navigation and embodied question answering (QA), covering the state-of-the-art approaches, evaluation metrics and datasets. Finally, with the new insights revealed through surveying the field, the paper will provide suggestions for simulator-for-task selections and recommendations for the future directions of the field.
引用
收藏
页码:230 / 244
页数:15
相关论文
共 50 条
  • [31] Human-AI Collaboration for Remote Sighted Assistance: Perspectives from the LLM Era
    Yu, Rui
    Lee, Sooyeon
    Xie, Jingyi
    Billah, Syed Masum
    Carroll, John M.
    FUTURE INTERNET, 2024, 16 (07)
  • [32] AI personalities: clues from animal research
    De Winter, Gunnar
    JOURNAL OF EXPERIMENTAL & THEORETICAL ARTIFICIAL INTELLIGENCE, 2018, 30 (05) : 547 - 559
  • [33] Edge AI: A survey
    Singh R.
    Gill S.S.
    Internet of Things and Cyber-Physical Systems, 2023, 3 : 71 - 92
  • [34] Vulnerable AI: A Survey
    Afolabi, Akindele Segun
    Akinola, Olubunmi Adewale
    2024 IEEE INTERNATIONAL SYMPOSIUM ON TECHNOLOGY AND SOCIETY, ISTAS 2024, 2024,
  • [35] User Group Analytics Survey and Research Opportunities
    Omidvar-Tehrani, Behrooz
    Amer-Yahia, Sihem
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2020, 32 (10) : 2040 - 2059
  • [36] Vision-Language Models for Vision Tasks: A Survey
    Zhang, Jingyi
    Huang, Jiaxing
    Jin, Sheng
    Lu, Shijian
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (08) : 5625 - 5644
  • [37] A research survey: review of AI solution strategies of job shop scheduling problem
    Banu Çaliş
    Serol Bulkan
    Journal of Intelligent Manufacturing, 2015, 26 : 961 - 973
  • [38] A research survey: review of AI solution strategies of job shop scheduling problem
    Calis, Banu
    Bulkan, Serol
    JOURNAL OF INTELLIGENT MANUFACTURING, 2015, 26 (05) : 961 - 973
  • [39] Toward the novel AI tasks in infection biology
    Yakimovich, Artur
    MSPHERE, 2024, 9 (02)
  • [40] AI foundation models for experimental fusion tasks
    Churchill, R. Michael
    FRONTIERS IN PHYSICS, 2025, 12