Implicit Shape Model Trees: Recognition of 3-D Indoor Scenes and Prediction of Object Poses for Mobile Robots

被引:0
作者
Meissner, Pascal [1 ,3 ]
Dillmann, Ruediger [2 ]
机构
[1] Univ Aberdeen, Sch Engn, Aberdeen AB24 3UE, Scotland
[2] Karlsruhe Inst Technol KIT, Humanoids & Intelligence Syst Lab HIS, D-76131 Karlsruhe, Germany
[3] Tech Univ Appl Sci Wuerzburg Schweinfurt THWS, Ctr Artificial Intelligence & Robot CAIRO, D-97082 Wurzburg, Germany
关键词
part-based models; Hough transform; spatial relations; object arrangements; object search; mobile robotics; SEARCH;
D O I
10.3390/robotics12060158
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This article describes an approach for mobile robots to identify scenes in configurations of objects spread across dense environments. This identification is enabled by intertwining the robotic object search and the scene recognition on already detected objects. We proposed "Implicit Shape Model (ISM) trees" as a scene model to solve these two tasks together. This article presents novel algorithms for ISM trees to recognize scenes and predict object poses. For us, scenes are sets of objects, some of which are interrelated by 3D spatial relations. Yet, many false positives may occur when using single ISMs to recognize scenes. We developed ISM trees, which is a hierarchical model of multiple interconnected ISMs, to remedy this. In this article, we contribute a recognition algorithm that allows the use of these trees for recognizing scenes. ISM trees should be generated from human demonstrations of object configurations. Since a suitable algorithm was unavailable, we created an algorithm for generating ISM trees. In previous work, we integrated the object search and scene recognition into an active vision approach that we called "Active Scene Recognition". An efficient algorithm was unavailable to make their integration using predicted object poses effective. Physical experiments in this article show that the new algorithm we have contributed overcomes this problem.
引用
收藏
页数:33
相关论文
共 61 条
  • [1] Organizing objects by predicting user preferences through collaborative filtering
    Abdo, Nichola
    Stachniss, Cyrill
    Spinello, Luciano
    Burgard, Wolfram
    [J]. INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2016, 35 (13) : 1587 - 1608
  • [2] Search in the real world: Active visual object search based on spatial relations
    Aydemir, A.
    Sjoo, K.
    Folkesson, J.
    Pronobis, A.
    Jensfelt, P.
    [J]. 2011 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2011,
  • [3] GENERALIZING THE HOUGH TRANSFORM TO DETECT ARBITRARY SHAPES
    BALLARD, DH
    [J]. PATTERN RECOGNITION, 1981, 13 (02) : 111 - 122
  • [4] COSMO: Contextualized scene modeling with Boltzmann Machines
    Bozcan, Ilker
    Kalkan, Sinan
    [J]. ROBOTICS AND AUTONOMOUS SYSTEMS, 2019, 113 : 132 - 148
  • [5] Burschka D., 2019, P IEEERSJ INT C INTE
  • [6] A Comprehensive Survey of Scene Graphs: Generation and Application
    Chang, Xiaojun
    Ren, Pengzhen
    Xu, Pengfei
    Li, Zhihui
    Chen, Xiaojiang
    Hauptmann, Alex
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (01) : 1 - 26
  • [7] Danielczuk M., 2019, P IEEE INT C ROBOTIC
  • [8] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
  • [9] Dogar M.R., 2013, P 2013 IEEE INT C RO
  • [10] Visual Object Search by Learning Spatial Context
    Druon, Raphael
    Yoshiyasu, Yusuke
    Kanezaki, Asako
    Watt, Alassane
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02) : 1279 - 1286