Occlusion-Aware Crowd Navigation Using People as Sensors

被引:5
|
作者
Mun, Ye-Ji [1 ]
Itkina, Masha [2 ]
Liu, Shuijing [1 ]
Driggs-Campbell, Katherine [1 ]
机构
[1] Univ Illinois, Elect & Comp Engn Dept, Champaign, IL 61820 USA
[2] Stanford Univ, Aeronaut & Astronaut Dept, Stanford, CA USA
来源
2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023) | 2023年
基金
美国国家科学基金会;
关键词
ROBOT NAVIGATION; OBSTACLES;
D O I
10.1109/ICRA48891.2023.10160715
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Autonomous navigation in crowded spaces poses a challenge for mobile robots due to the highly dynamic, partially observable environment. Occlusions are highly prevalent in such settings due to a limited sensor field of view and obstructing human agents. Previous work has shown that observed interactive behaviors of human agents can be used to estimate potential obstacles despite occlusions. We propose integrating such social inference techniques into the planning pipeline. We use a variational autoencoder with a specially designed loss function to learn representations that are meaningful for occlusion inference. This work adopts a deep reinforcement learning approach to incorporate the learned representation into occlusion-aware planning. In simulation, our occlusionaware policy achieves comparable collision avoidance performance to fully observable navigation by estimating agents in occluded spaces. We demonstrate successful policy transfer from simulation to the real-world Turtlebot 2i. To the best of our knowledge, this work is the first to use social occlusion inference for crowd navigation. Our implementation is available at https://github.com/yejimun/PaS_CrowdNav.
引用
收藏
页码:12031 / 12037
页数:7
相关论文
共 50 条
  • [1] Occlusion-Aware R-CNN: Detecting Pedestrians in a Crowd
    Zhang, Shifeng
    Wen, Longyin
    Bian, Xiao
    Lei, Zhen
    Li, Stan Z.
    COMPUTER VISION - ECCV 2018, PT III, 2018, 11207 : 657 - 674
  • [2] Towards Enforcing Social Distancing Regulations with Occlusion-Aware Crowd Detection
    Cong, Cong
    Yang, Zhichao
    Song, Yang
    Pagnucco, Maurice
    16TH IEEE INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV 2020), 2020, : 297 - 302
  • [3] CONet: Crowd and occlusion-aware network for occluded human pose estimation
    Bai, Xiuxiu
    Wei, Xing
    Wang, Zengying
    Zhang, Miao
    NEURAL NETWORKS, 2024, 172
  • [4] Occlusion-Aware Interfaces
    Vogel, Daniel
    Balakrishnan, Ravin
    CHI2010: PROCEEDINGS OF THE 28TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, VOLS 1-4, 2010, : 263 - 272
  • [5] Occlusion-Aware View Interpolation
    Serdar Ince
    Janusz Konrad
    EURASIP Journal on Image and Video Processing, 2008
  • [6] Slicing the View: Occlusion-Aware View-Based Robot Navigation
    Dederscheck, David
    Zahn, Martin
    Friedrich, Holger
    Mester, Rudolf
    PATTERN RECOGNITION, 2010, 6376 : 111 - 120
  • [7] Occlusion-aware Pedestrian Detection
    Apostolopoulos, Christos
    Nasrollahi, Kamal
    Yang, M. -Hsuan
    Jahromi, Mohammad N. S.
    Moeslund, Thomas B.
    ELEVENTH INTERNATIONAL CONFERENCE ON MACHINE VISION (ICMV 2018), 2019, 11041
  • [8] Occlusion-Aware View Interpolation
    Ince, Serdar
    Konrad, Janusz
    EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2008, 2008 (1)
  • [9] Occlusion-Aware Stereo Matching
    Xu, Jintao
    Yang, Qingxiong
    Feng, Zuren
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2016, 120 (03) : 256 - 271
  • [10] Occlusion-Aware Stereo Matching
    Jintao Xu
    Qingxiong Yang
    Zuren Feng
    International Journal of Computer Vision, 2016, 120 : 256 - 271