Model-Free Authoring by Demonstration of Assembly Instructions in Augmented Reality

被引:10
作者
Stanescu, Ana [1 ]
Mohr, Peter [1 ]
Schmalstieg, Dieter [1 ,3 ]
Kalkofen, Denis [1 ,2 ]
机构
[1] Graz Univ Technol, Graz, Austria
[2] Flinders Univ S Australia, Adelaide, SA, Australia
[3] VRVis GmbH, Vienna, Austria
基金
奥地利科学基金会;
关键词
Assembly tutorial; assembly instructions; 3D reconstruction; authoring by demonstration; augmented reality; TRACKING; RECONSTRUCTION; RECOGNITION;
D O I
10.1109/TVCG.2022.3203104
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Among the most compelling applications of Augmented Reality are spatially registered tutorials. The effort of creating such instructions remains one of the obstacles precluding a wider use. We propose a system that is capable of extracting 3D instructions in a completely model-free manner from demonstrations, based on volumetric changes. The instructions are visualised later in an interactive Augmented Reality guidance application, on a mobile head-mounted display. We enable a technology that can be used by anyone in an ad-hoc tabletop setup for assemblies with rigid components.
引用
收藏
页码:3821 / 3831
页数:11
相关论文
共 50 条
  • [1] Alves J, 2019, IEEE INT CONF AUTON, P168, DOI 10.1109/icarsc.2019.8733642
  • [2] DynaSLAM: Tracking, Mapping, and Inpainting in Dynamic Scenes
    Bescos, Berta
    Facil, Jose M.
    Civera, Javier
    Neira, Jose
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (04): : 4076 - 4083
  • [3] Augmented reality via expert demonstration authoring (AREDA)
    Bhattacharya, Bhaskar
    Winer, Eliot H.
    [J]. COMPUTERS IN INDUSTRY, 2019, 105 : 61 - 79
  • [4] Büttner S, 2020, IN SY AP IN WE HC, V12203, P153, DOI 10.1007/978-3-030-50344-4_12
  • [5] ProcessAR: An augmented reality-based tool to create in-situ procedural 2D/3D AR Instructions
    Chidambaram, Subramanian
    Huang, Hank
    He, Fengming
    Qian, Xun
    Villanueva, Ana M.
    Redick, Thomas S.
    Stuerzlinger, Wolfgang
    Ramani, Karthik
    [J]. PROCEEDINGS OF THE 2021 ACM DESIGNING INTERACTIVE SYSTEMS CONFERENCE (DIS 2021), 2021, : 234 - 249
  • [6] Ellson J, 2004, MATH VIS, P127
  • [7] Fehr Marius, 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA), P5237, DOI 10.1109/ICRA.2017.7989614
  • [8] Finman R, 2013, 2013 EUROPEAN CONFERENCE ON MOBILE ROBOTS (ECMR 2013), P178, DOI 10.1109/ECMR.2013.6698839
  • [9] Furrer F, 2018, IEEE INT C INT ROBOT, P6835, DOI 10.1109/IROS.2018.8594391
  • [10] Golparvar-Fard M., 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), P249, DOI 10.1109/ICCVW.2011.6130250