Visual Odometry and Mapping for Autonomous Flight Using an RGB-D Camera

被引:178
|
作者
Huang, Albert S. [1 ]
Bachrach, Abraham [1 ]
Henry, Peter [2 ]
Krainin, Michael [2 ]
Maturana, Daniel [3 ]
Fox, Dieter [2 ]
Roy, Nicholas [1 ]
机构
[1] MIT, Comp Sci & Artificial Intelligence Lab, 77 Massachusetts Ave, Cambridge, MA 02139 USA
[2] Univ Washington, Dept Comp Sci & Engn, Seattle, WA 98195 USA
[3] Pontificia Univ Catolica Chile, Dept Comp Sci, Santiago, Chile
来源
ROBOTICS RESEARCH, ISRR | 2017年 / 100卷
关键词
HELICOPTER;
D O I
10.1007/978-3-319-29363-9_14
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
RGB-D cameras provide both a color image and per-pixel depth estimates. The richness of their data and the recent development of low-cost sensors have combined to present an attractive opportunity for mobile robotics research. In this paper, we describe a system for visual odometry and mapping using an RGB-D camera, and its application to autonomous flight. By leveraging results from recent state-of-the-art algorithms and hardware, our system enables 3D flight in cluttered environments using only onboard sensor data. All computation and sensing required for local position control are performed onboard the vehicle, reducing the dependence on unreliable wireless links. We evaluate the effectiveness of our system for stabilizing and controlling a quadrotor micro air vehicle, demonstrate its use for constructing detailed 3D maps of an indoor environment, and discuss its limitations.
引用
收藏
页数:18
相关论文
共 50 条
  • [31] VISUAL ODOMETRY FOR RGB-D CAMERAS FOR DYNAMIC SCENES
    Azartash, Haleh
    Lee, Kyoung-Rok
    Nguyen, Truong Q.
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [32] Autonomous Exploration for 3D Mapping Using a Mobile Manipulator Robot with an RGB-D Camera
    Uomi, Ryota
    Yorozu, Ayanori
    Ohya, Akihisa
    INTELLIGENT AUTONOMOUS SYSTEMS 17, IAS-17, 2023, 577 : 441 - 454
  • [33] Direct RGB-D visual odometry with point features
    Yao, Zhigang
    An, Xu
    Charrier, Christophe
    Rosenberger, Christophe
    INTELLIGENT SERVICE ROBOTICS, 2024, 17 (05) : 1077 - 1089
  • [34] Maximum Clique based RGB-D Visual Odometry
    Zhang, Yigong
    Hou, Zhixing
    Yang, Jian
    Kong, Hui
    2016 23RD INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2016, : 2764 - 2769
  • [35] Experimental Evaluation of RGB-D Visual Odometry Methods
    Fang, Zheng
    Zhang, Yu
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2015, 12
  • [36] An Adaptive Visual Odometry Based on RGB-D Sensors
    Zheng, Enhui
    Wang, Tantan
    Liu, Zheng
    Xu, Ling
    2019 4TH INTERNATIONAL CONFERENCE ON ELECTROMECHANICAL CONTROL TECHNOLOGY AND TRANSPORTATION (ICECTT 2019), 2019, : 154 - 158
  • [37] Point Cloud Mapping Measurements using Kinect RGB-D Sensor and Kinect Fusion for Visual Odometry
    Namitha, N.
    Vaitheeswaran, S. M.
    Jayasree, V. K.
    Bharat, M. K.
    TWELFTH INTERNATIONAL CONFERENCE ON COMMUNICATION NETWORKS, ICCN 2016 / TWELFTH INTERNATIONAL CONFERENCE ON DATA MINING AND WAREHOUSING, ICDMW 2016 / TWELFTH INTERNATIONAL CONFERENCE ON IMAGE AND SIGNAL PROCESSING, ICISP 2016, 2016, 89 : 209 - 212
  • [38] A Fast Feature Tracking Algorithm for Visual Odometry and Mapping Based on RGB-D Sensors
    Silva, Bruno M. F.
    Goncalves, Luiz M. G.
    2014 27TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI), 2014, : 227 - 234
  • [39] Semantic Mapping for Smart Wheelchairs Using RGB-D Camera
    Wei, Zhixuan
    Chen, Weidong
    Wang, Jingchuan
    JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS, 2013, 3 (01) : 94 - 100
  • [40] 3-D Mapping and Localization using RGB-D Camera
    Pudchuen, Noppadol
    Jitviriya, Wisanu
    2019 FIRST INTERNATIONAL SYMPOSIUM ON INSTRUMENTATION, CONTROL, ARTIFICIAL INTELLIGENCE, AND ROBOTICS (ICA-SYMP 2019), 2019, : 139 - 142