Real-time monocular depth estimation with adaptive receptive fields

被引:0
|
作者
Zhenyan Ji
Xiaojun Song
Xiaoxuan Guo
Fangshi Wang
José Enrique Armendáriz-Iñigo
机构
[1] Beijing Jiaotong University,School of Software Engineering
[2] Public University of Navarre,Department of Statistics, Computer Science and Mathematics
来源
关键词
Monocular depth estimation; Adaptive receptive field; Real-time performance; Convolutional neural network;
D O I
暂无
中图分类号
学科分类号
摘要
Monocular depth estimation is a popular research topic in the field of autonomous driving. Nowadays many models are leading in accuracy but performing poorly in a real-time scenario. To effectively increase the depth estimation efficiency, we propose a novel model combining a multi-scale pyramid architecture for depth estimation together with adaptive receptive fields. The pyramid architecture reduces the trainable parameters from dozens of mega to less than 10 mega. Adaptive receptive fields are more sensitive to objects at different depth/distances in images, leading to better accuracy. We have adopted stacked convolution kernels instead of raw kernels to compress the model. Thus, the model that we proposed performs well in both real-time performance and estimation accuracy. We provide a set of experiments where our model performs better in terms of Eigen split than other previously known models. Furthermore, we show that our model is also better in runtime performance in regard to the depth estimation to the rest of models but the Pyd-Net model. Finally, our model is a lightweight depth estimation model with state-of-the-art accuracy.
引用
收藏
页码:1369 / 1381
页数:12
相关论文
共 50 条
  • [31] Real-time monocular depth estimation for low-power embedded systems using deep learning
    Liu, Shuyao
    Zhao, Shuo
    Zhang, Pu
    Cheng, Jingjing
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2022, 19 (05) : 997 - 1006
  • [32] Adaptive confidence thresholding for monocular depth estimation
    Choi, Hyesong
    Lee, Hunsang
    Kim, Sunkyung
    Kim, Sunok
    Kim, Seungryong
    Sohn, Kwanghoon
    Min, Dongbo
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 12788 - 12798
  • [33] Monocular Depth Estimation with Adaptive Geometric Attention
    Naderi, Taher
    Sadovnik, Amir
    Hayward, Jason
    Qi, Hairong
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 617 - 627
  • [34] Real-Time Monocular Depth Estimation using Synthetic Data with Domain Adaptation via Image Style Transfer
    Atapour-Abarghouei, Amir
    Breckon, Toby P.
    2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 2800 - 2810
  • [35] Synthetic Data Enhancement and Network Compression Technology of Monocular Depth Estimation for Real-Time Autonomous Driving System
    Jun, Woomin
    Yoo, Jisang
    Lee, Sungjin
    SENSORS, 2024, 24 (13)
  • [36] Monocular Real Time Full Resolution Depth Estimation Arrangement with a Tunable Lens
    Oliva-Garcia, Ricardo
    Ceruso, Sabato
    Marichal-Hernandez, Jose G.
    Rodriguez-Ramos, Jose M.
    APPLIED SCIENCES-BASEL, 2022, 12 (06):
  • [37] Real-time, dense UAV mapping by leveraging monocular depth prediction with monocular-inertial SLAM
    Habib, Yassine
    Papadakis, Panagiotis
    Le Barz, Cedric
    Fagette, Antoine
    Goncalves, Tiago
    Buche, Cedric
    ADVANCED ROBOTICS, 2024, 38 (21) : 1555 - 1566
  • [38] Real-Time Dense Monocular SLAM With Online Adapted Depth Prediction Network
    Luo, Hongcheng
    Gao, Yang
    Wu, Yuhao
    Liao, Chunyuan
    Yang, Xin
    Cheng, Kwang-Ting
    IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (02) : 470 - 483
  • [39] Real-time human posture estimation using monocular thermal images
    Iwasawa, S
    Ebihara, K
    Ohya, J
    Morishima, S
    AUTOMATIC FACE AND GESTURE RECOGNITION - THIRD IEEE INTERNATIONAL CONFERENCE PROCEEDINGS, 1998, : 492 - 497
  • [40] Real-Time Estimation of Drivable Image Area based on Monocular Vision
    Miranda Neto, A.
    Victorino, A. Correa
    Fantoni, I.
    Ferreira, J. V.
    2013 IEEE INTELLIGENT VEHICLES SYMPOSIUM WORKSHOPS (IV WORKSHOPS), 2013, : 63 - 68