V.Ra: An In-Situ Visual Authoring System for Robot-IoT Task Planning with Augmented Reality

被引:14
作者
Cao, Yuanzhi [1 ]
Xu, Zhuangying [1 ]
Li, Fan [2 ]
Zhong, Wentao [1 ]
Huo, Ke [1 ]
Ramani, Karthik [1 ,3 ]
机构
[1] Purdue Univ, Sch Mech Engn, W Lafayette, IN 47907 USA
[2] Tsinghua Univ, Sch Mech Engn, Beijing, Peoples R China
[3] Sch Elect & Comp Engn, W Lafayette, IN USA
来源
PROCEEDINGS OF THE 2019 ACM DESIGNING INTERACTIVE SYSTEMS CONFERENCE (DIS 2019) | 2019年
关键词
Robotic task authoring; Human-robot interaction; Augmented Reality; SLAM; Internet-of-Robotic-thing; Robot navigation;
D O I
10.1145/3322276.3322278
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We present V.Ra, a visual and spatial programming system for robot-IoT task authoring. In V.Ra, programmable mobile robots serve as binding agents to link the stationary IoTs and perform collaborative tasks. We establish an ecosystem that coherently connects the three key elements of robot task planning, the human, robot and IoT, with one single mobile AR device. Users can perform task authoring with the Augmented Reality (AR) handheld interface, then placing the AR device onto the mobile robot directly transfers the task plan in a what-you-do-is-what-robot-does (WYDWRD) manner. The mobile device mediates the interactions between the user, robot, and the IoT oriented tasks, and guides the path planning execution with the embedded simultaneous localization and mapping (SLAM) capability. We demonstrate that V.Ra enables instant, robust and intuitive room-scale navigatory and interactive task authoring through various use cases and preliminary studies.
引用
收藏
页码:1059 / 1070
页数:12
相关论文
共 42 条
  • [1] Internet of Things: A Survey on Enabling Technologies, Protocols, and Applications
    Al-Fuqaha, Ala
    Guizani, Mohsen
    Mohammadi, Mehdi
    Aledhari, Mohammed
    Ayyash, Moussa
    [J]. IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2015, 17 (04): : 2347 - 2376
  • [2] Alexandrova S, 2015, IEEE INT CONF ROBOT, P5537, DOI 10.1109/ICRA.2015.7139973
  • [3] [Anonymous], 2013, P 2013 ACM C PERVASI
  • [4] A survey of augmented reality
    [J]. 1600, Now Publishers Inc (08): : 2 - 3
  • [5] Birkenkampf P, 2014, IEEE-RAS INT C HUMAN, P152, DOI 10.1109/HUMANOIDS.2014.7041352
  • [6] Ani-Bot: A Modular Robotics System Supporting Creation, Tweaking, and Usage with Mixed-Reality Interactions
    Cao, Yuanzhi
    Xu, Zhuangying
    Glenn, Terrell
    Huo, Ke
    Ramani, Karthik
    [J]. PROCEEDINGS OF THE TWELFTH INTERNATIONAL CONFERENCE ON TANGIBLE, EMBEDDED, AND EMBODIED INTERACTION (TEI'18), 2018, : 419 - 428
  • [7] Design Vocabulary for Human-IoT Systems Communication
    Chuang, Yaliang
    Chen, Lin-Lin
    Liu, Yoga
    [J]. PROCEEDINGS OF THE 2018 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI 2018), 2018,
  • [8] Ciocarlie M, 2012, IEEE INT C INT ROBOT, P5313, DOI 10.1109/IROS.2012.6385907
  • [9] Ens B., 2017, P 43 GRAPH INT C, P156, DOI DOI 10.20380/GI2017.20
  • [10] Spatial Analytic Interfaces: Spatial User Interfaces for In Situ Visual Analytics
    Ens, Barrett
    Irani, Pourang
    [J]. IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2017, 37 (02) : 66 - 79