Research on Environment Perception System of Quadruped Robots Based on LiDAR and Vision

被引:15
作者
Chen, Guangrong [1 ]
Hong, Liang [1 ]
机构
[1] Beijing Jiaotong Univ, Robot Res Ctr, Beijing 100044, Peoples R China
基金
中国国家自然科学基金;
关键词
quadruped robot; simultaneous localization and mapping; image processing; deep learning; MODEL; MAP;
D O I
10.3390/drones7050329
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
Due to the high stability and adaptability, quadruped robots are currently highly discussed in the robotics field. To overcome the complicated environment indoor or outdoor, the quadruped robots should be configured with an environment perception system, which mostly contain LiDAR or a vision sensor, and SLAM (Simultaneous Localization and Mapping) is deployed. In this paper, the comparative experimental platforms, including a quadruped robot and a vehicle, with LiDAR and a vision sensor are established firstly. Secondly, a single sensor SLAM, including LiDAR SLAM and Visual SLAM, are investigated separately to highlight their advantages and disadvantages. Then, multi-sensor SLAM based on LiDAR and vision are addressed to improve the environmental perception performance. Thirdly, the improved YOLOv5 (You Only Look Once) by adding ASFF (adaptive spatial feature fusion) is employed to do the image processing of gesture recognition and achieve the human-machine interaction. Finally, the challenge of environment perception system for mobile robot based on comparison between wheeled and legged robots is discussed. This research provides an insight for the environment perception of legged robots.
引用
收藏
页数:19
相关论文
共 39 条
[1]   Pose Estimation of a Mobile Robot Based on Fusion of IMU Data and Vision Data Using an Extended Kalman Filter [J].
Alatise, Mary B. ;
Hancke, Gerhard P. .
SENSORS, 2017, 17 (10)
[2]   Evaluating Map-Based RGB-D SLAM on an Autonomous Walking Robot [J].
Belter, Dominik ;
Nowicki, Michal ;
Skrzypczynski, Piotr .
CHALLENGES IN AUTOMATION, ROBOTICS AND MEASUREMENT TECHNIQUES, 2016, 440 :469-481
[3]   Radar SLAM using visual features [J].
Callmer, Jonas ;
Tornqvist, David ;
Gustafsson, Fredrik ;
Svensson, Henrik ;
Carlbom, Pelle .
EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2011,
[4]   Optimization and evaluation of swing leg retraction for a hydraulic biped robot [J].
Chen, Guangrong ;
Wei, Ningze ;
Lu, HuaFeng ;
Yan, Lei ;
Li, Jin .
JOURNAL OF FIELD ROBOTICS, 2023, 40 (06) :1525-1542
[5]   Perturbation-based approximate analytic solutions to an articulated SLIP model for legged robots [J].
Chen, Guangrong ;
Wei, Ningze ;
Yan, Lei ;
Lu, Huafeng ;
Li, Jin .
COMMUNICATIONS IN NONLINEAR SCIENCE AND NUMERICAL SIMULATION, 2023, 117
[6]   Virtual Model Control for Quadruped Robots [J].
Chen, Guangrong ;
Guo, Sheng ;
Hou, Bowen ;
Wang, Junzheng .
IEEE ACCESS, 2020, 8 :140736-140751
[7]   Compliance control for a hydraulic bouncing system [J].
Chen, Guangrong ;
Wang, Junzheng ;
Wang, Shoukun ;
Zhao, Jiangbo ;
Shen, Wei .
ISA TRANSACTIONS, 2018, 79 :232-238
[8]   MonoSLAM: Real-time single camera SLAM [J].
Davison, Andrew J. ;
Reid, Ian D. ;
Molton, Nicholas D. ;
Stasse, Olivier .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (06) :1052-1067
[9]   Design and implementation of a radar and camera-based obstacle classification system using machine-learning techniques [J].
Dhouioui, Mohamed ;
Frikha, Tarek .
JOURNAL OF REAL-TIME IMAGE PROCESSING, 2021, 18 (06) :2403-2415
[10]   Improved Vehicle Localization Using On-Board Sensors and Vehicle Lateral Velocity [J].
Gao, Letian ;
Xiong, Lu ;
Xia, Xin ;
Lu, Yishi ;
Yu, Zhuoping ;
Khajepour, Amir .
IEEE SENSORS JOURNAL, 2022, 22 (07) :6818-6831