Semantic-Aware Environment Perception for Mobile Human-Robot Interaction

被引:1
作者
Hempel, Thorsten [1 ]
Fiedler, Marc-Andre [1 ]
Khalifa, Aly [1 ]
Al-Hamadi, Ayoub [1 ]
Dinges, Laslo [1 ]
机构
[1] Otto von Guericke Univ, Neuroinformat Technol, Magdeburg, Germany
来源
PROCEEDINGS OF THE 12TH INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS (ISPA 2021) | 2021年
关键词
human-robot interaction; semantic objects; interaction willingness; RECOGNITION;
D O I
10.1109/ISPA52656.2021.9552148
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Current technological advances open up new opportunities for bringing human-machine interaction to a new level of human-centered cooperation. In this context, a key issue is the semantic understanding of the environment in order to enable mobile robots more complex interactions and a facilitated communication with humans. Prerequisites are the vision-based registration of semantic objects and humans where the latter are further analyzed for potential interaction partners. Despite significant research achievements, the reliable and fast registration of semantic information still remains a challenging tasks for mobile robots in real-world scenarios. In this paper, we present a vision-based system for mobile assistive robots to enable a semantic-aware environment perception without additional a-priori knowledge. We deploy our system on a mobile humanoid robot that enables us to test our methods in real-world applications.
引用
收藏
页码:200 / 203
页数:4
相关论文
共 15 条
[1]   Hobbit: Providing Fall Detection and Prevention for the Elderly in the Real World [J].
Bajones, Markus ;
Fischinger, David ;
Weiss, Astrid ;
Wolf, Daniel ;
Vincze, Markus ;
de la Puente, Paloma ;
Koertner, Tobias ;
Weninger, Markus ;
Papoutsakis, Konstantinos ;
Michel, Damien ;
Qammaz, Ammar ;
Panteleris, Paschalis ;
Foukarakis, Michalis ;
Adami, Ilia ;
Ioannidi, Danai ;
Leonidis, Asterios ;
Antona, Margherita ;
Argyros, Antonis ;
Mayer, Peter ;
Panek, Paul ;
Eftring, Hakan ;
Frennert, Susanne .
JOURNAL OF ROBOTICS, 2018, 2018
[2]  
Bochinski Erik., 2017, High-speed tracking-by-detection without using image information [challenge winner iwot4s], DOI [DOI 10.1109/AVSS.2017.8078516, 10.1109/AVSS. 2017.8078516]
[3]  
Bochkovskiy A, 2020, Arxiv, DOI [arXiv:2004.10934, DOI 10.48550/ARXIV.2004.10934]
[4]   Rich feature hierarchies for accurate object detection and semantic segmentation [J].
Girshick, Ross ;
Donahue, Jeff ;
Darrell, Trevor ;
Malik, Jitendra .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :580-587
[5]   One Millisecond Face Alignment with an Ensemble of Regression Trees [J].
Kazemi, Vahid ;
Sullivan, Josephine .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :1867-1874
[6]   RTAB-Map as an open-source lidar and visual simultaneous localization and mapping library for large-scale and long-term online operation [J].
Labbe, Mathieu ;
Michaud, Francois .
JOURNAL OF FIELD ROBOTICS, 2019, 36 (02) :416-446
[7]   Robust recognition and pose estimation of 3D objects based on evidence fusion in a sequence of images [J].
Lee, Sukhan ;
Lee, Seongsoo ;
Lee, Jeihun ;
Moon, Dongju ;
Kim, Eunyoung ;
Seo, Jeonghyun .
PROCEEDINGS OF THE 2007 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-10, 2007, :3773-+
[8]   Microsoft COCO: Common Objects in Context [J].
Lin, Tsung-Yi ;
Maire, Michael ;
Belongie, Serge ;
Hays, James ;
Perona, Pietro ;
Ramanan, Deva ;
Dollar, Piotr ;
Zitnick, C. Lawrence .
COMPUTER VISION - ECCV 2014, PT V, 2014, 8693 :740-755
[9]   SSD: Single Shot MultiBox Detector [J].
Liu, Wei ;
Anguelov, Dragomir ;
Erhan, Dumitru ;
Szegedy, Christian ;
Reed, Scott ;
Fu, Cheng-Yang ;
Berg, Alexander C. .
COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 :21-37
[10]   Object Detection and Recognition for Assistive Robots Experimentation and Implementation [J].
Martinez-Martin, Ester ;
del Pobil, Angel P. .
IEEE ROBOTICS & AUTOMATION MAGAZINE, 2017, 24 (03) :123-138