Real-time monocular depth estimation with adaptive receptive fields

被引:0
|
作者
Zhenyan Ji
Xiaojun Song
Xiaoxuan Guo
Fangshi Wang
José Enrique Armendáriz-Iñigo
机构
[1] Beijing Jiaotong University,School of Software Engineering
[2] Public University of Navarre,Department of Statistics, Computer Science and Mathematics
来源
关键词
Monocular depth estimation; Adaptive receptive field; Real-time performance; Convolutional neural network;
D O I
暂无
中图分类号
学科分类号
摘要
Monocular depth estimation is a popular research topic in the field of autonomous driving. Nowadays many models are leading in accuracy but performing poorly in a real-time scenario. To effectively increase the depth estimation efficiency, we propose a novel model combining a multi-scale pyramid architecture for depth estimation together with adaptive receptive fields. The pyramid architecture reduces the trainable parameters from dozens of mega to less than 10 mega. Adaptive receptive fields are more sensitive to objects at different depth/distances in images, leading to better accuracy. We have adopted stacked convolution kernels instead of raw kernels to compress the model. Thus, the model that we proposed performs well in both real-time performance and estimation accuracy. We provide a set of experiments where our model performs better in terms of Eigen split than other previously known models. Furthermore, we show that our model is also better in runtime performance in regard to the depth estimation to the rest of models but the Pyd-Net model. Finally, our model is a lightweight depth estimation model with state-of-the-art accuracy.
引用
收藏
页码:1369 / 1381
页数:12
相关论文
共 50 条
  • [1] Real-time monocular depth estimation with adaptive receptive fields
    Ji, Zhenyan
    Song, Xiaojun
    Guo, Xiaoxuan
    Wang, Fangshi
    Armendariz-Inigo, Jose Enrique
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2021, 18 (04) : 1369 - 1381
  • [2] Towards Real-Time Monocular Depth Estimation For Mobile Systems
    Deldjoo, Yashar
    Di Noia, Tommaso
    Di Sciascio, Eugenio
    Pernisco, Gaetano
    Reno, Vito
    Stella, Ettore
    MULTIMODAL SENSING AND ARTIFICIAL INTELLIGENCE: TECHNOLOGIES AND APPLICATIONS II, 2021, 11785
  • [3] Real-Time Depth Estimation from a Monocular Moving Camera
    Handa, Aniket
    Sharma, Prateek
    CONTEMPORARY COMPUTING, 2012, 306 : 494 - 495
  • [4] OptiDepthNet: A Real-Time Unsupervised Monocular Depth Estimation Network
    Wei, Feng
    Yin, XingHui
    Shen, Jie
    Wang, HuiBin
    WIRELESS PERSONAL COMMUNICATIONS, 2023, 128 (04) : 2831 - 2846
  • [5] Towards real-time unsupervised monocular depth estimation on CPU
    Poggi, Matteo
    Aleotti, Filippo
    Tosi, Fabio
    Mattoccia, Stefano
    2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2018, : 5848 - 5854
  • [6] Real-time Monocular Depth Estimation with Sparse Supervision on Mobile
    Yucel, Mehmet Kerim
    Dimaridou, Valia
    Drosou, Anastasios
    Saa-Garriga, Albert
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, : 2428 - 2437
  • [7] OptiDepthNet: A Real-Time Unsupervised Monocular Depth Estimation Network
    Feng Wei
    XingHui Yin
    Jie Shen
    HuiBin Wang
    Wireless Personal Communications, 2023, 128 : 2831 - 2846
  • [8] Real-Time Monocular Human Depth Estimation and Segmentation on Embedded Systems
    An, Shan
    Zhou, Fangru
    Yang, Mei
    Zhu, Haogang
    Fu, Changhong
    Tsintotas, Konstantinos A.
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 55 - 62
  • [9] Comparing Monocular Camera Depth Estimation Models for Real-time Applications
    Diab, Abdelrahman
    Sabry, Mohamed
    El Mougy, Amr
    ICAART: PROCEEDINGS OF THE 14TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE - VOL 3, 2022, : 673 - 680
  • [10] Real-time safety distance detection and warning for elevator inspection based on adaptive monocular depth estimation
    Yao, Bing
    Liu, Ji
    Luo, Hui
    MEASUREMENT, 2024, 235