Towards Real-Time Monocular Depth Estimation for Robotics: A Survey[-5pt]

被引:69
作者
Dong, Xingshuai [1 ]
Garratt, Matthew A. [1 ]
Anavatti, Sreenatha G. [1 ]
Abbass, Hussein A. [1 ]
机构
[1] Univ New South Wales, Sch Engn & Informat Technol, Canberra, ACT 2612, Australia
关键词
Estimation; Feature extraction; Robots; Cameras; Structure from motion; Three-dimensional displays; Task analysis; Monocular depth estimation; single image depth estimation; depth prediction; robotics; survey; OBSTACLE DETECTION; PREDICTION; NETWORK;
D O I
10.1109/TITS.2022.3160741
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
As an essential component for many autonomous driving and robotic activities such as ego-motion estimation, obstacle avoidance and scene understanding, monocular depth estimation (MDE) has attracted great attention from the computer vision and robotics communities. Over the past decades, a large number of methods have been developed. To the best of our knowledge, however, there is not a comprehensive survey of MDE. This paper aims to bridge this gap by reviewing 197 relevant articles published between 1970 and 2021. In particular, we provide a comprehensive survey of MDE covering various methods, introduce the popular performance evaluation metrics and summarize publically available datasets. We also summarize available open-source implementations of some representative methods and compare their performances. Furthermore, we review the application of MDE in some important robotic tasks. Finally, we conclude this paper by presenting some promising directions for future research. This survey is expected to assist readers to navigate this research field.
引用
收藏
页码:16940 / 16961
页数:22
相关论文
共 197 条
[41]  
Forouher D, 2016, I C CONT AUTOMAT ROB
[42]   Deep Ordinal Regression Network for Monocular Depth Estimation [J].
Fu, Huan ;
Gong, Mingming ;
Wang, Chaohui ;
Batmanghelich, Kayhan ;
Tao, Dacheng .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2002-2011
[43]   Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue [J].
Garg, Ravi ;
VijayKumar, B. G. ;
Carneiro, Gustavo ;
Reid, Ian .
COMPUTER VISION - ECCV 2016, PT VIII, 2016, 9912 :740-756
[44]   Vision meets robotics: The KITTI dataset [J].
Geiger, A. ;
Lenz, P. ;
Stiller, C. ;
Urtasun, R. .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2013, 32 (11) :1231-1237
[45]   Digging Into Self-Supervised Monocular Depth Estimation [J].
Godard, Clement ;
Mac Aodha, Oisin ;
Firman, Michael ;
Brostow, Gabriel .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3827-3837
[46]   Unsupervised Monocular Depth Estimation with Left-Right Consistency [J].
Godard, Clement ;
Mac Aodha, Oisin ;
Brostow, Gabriel J. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6602-6611
[47]  
Guizilini V., 2020, C ROBOT LEARNING, P503
[48]   3D Packing for Self-Supervised Monocular Depth Estimation [J].
Guizilini, Vitor ;
Ambrus, Rares ;
Pillai, Sudeep ;
Raventos, Allan ;
Gaidon, Adrien .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2482-2491
[49]  
Guizilini Vitor, 2020, INT C LEARN REPR ICL
[50]   Learning Monocular Depth by Distilling Cross-Domain Stereo Networks [J].
Guo, Xiaoyang ;
Li, Hongsheng ;
Yi, Shuai ;
Ren, Jimmy ;
Wang, Xiaogang .
COMPUTER VISION - ECCV 2018, PT XI, 2018, 11215 :506-523