MaskVO: Self-Supervised Visual Odometry with a Learnable Dynamic Mask

被引:4
|
作者
Xuan, Weihao [1 ]
Ren, Ruijie [2 ]
Wu, Siyuan [3 ]
Chen, Changhao [4 ]
机构
[1] Univ Leeds, Sch Mech Engn, Leeds LS2 9JT, W Yorkshire, England
[2] Tech Univ Denmark, Dept Elect Engn, DK-2800 Lyngby, Denmark
[3] Delft Univ Technol, Dept Cognit Robot, TU Delft, NL-2628 CD Delft, Netherlands
[4] Univ Oxford, Dept Comp Sci, 15 Parks Rd, Oxford, England
来源
2022 IEEE/SICE INTERNATIONAL SYMPOSIUM ON SYSTEM INTEGRATION (SII 2022) | 2022年
关键词
D O I
10.1109/SII52469.2022.9708796
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Visual odometry, one of the main research topics in robotics, is capable of offering pose information for mobile robotic systems. Recent advances in deep learning allow mobile robots to learn ego-motion and depth maps jointly in a self-supervised manner. However, the existing approaches are confounded by the problem of scale ambiguity and by environmental issues, preventing real-world applications. Our work aims to tackle these two problems by proposing a self-supervised visual odometry model that exploits the temporal dependencies of image sequences and produces scale-consistent motion transformations from a monocular camera. Our proposed framework is integrated with a novel mask network to provide learnable dynamic masks that reduce the influences of scene dynamics and illumination changes. We evaluated our framework against public benchmarks, showing that our MaskVO outperforms existing baselines. Moreover, we also investigated the effectiveness of our proposed dynamic mask network via a detailed ablation study.
引用
收藏
页码:225 / 231
页数:7
相关论文
共 50 条
  • [1] Self-Supervised Deep Visual Odometry with Online Adaptation
    Li, Shunkai
    Wang, Xin
    Cao, Yingdian
    Xue, Fei
    Yan, Zike
    Zha, Hongbin
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 6338 - 6347
  • [2] Self-supervised Visual Odometry Based on Geometric Consistency
    Song, Rujun
    Liu, Jiaqi
    Liao, Kaisheng
    Xiao, Zhuoling
    Yan, Bo
    2023 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS, 2023,
  • [3] Sequential Adversarial Learning for Self-Supervised Deep Visual Odometry
    Li, Shunkai
    Xue, Fei
    Wang, Xin
    Yan, Zike
    Zha, Hongbin
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 2851 - 2860
  • [4] Online Self-Supervised Monocular Visual Odometry for Ground Vehicles
    Lee, Rhoram
    Daniilidis, Kostas
    Lee, Daniel D.
    2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2015, : 5232 - 5238
  • [5] Keypoint Heatmap Guided Self-Supervised Monocular Visual Odometry
    Haixin Xiu
    Yiyou Liang
    Hui Zeng
    Journal of Intelligent & Robotic Systems, 2022, 105
  • [6] Self-supervised Pretraining and Finetuning for Monocular Depth and Visual Odometry
    Antsfeldi, Leonid
    Chidlovskii, Boris
    2024 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2024), 2024, : 14669 - 14676
  • [7] Higher accuracy self-supervised visual odometry with reliable projection
    Shi Zhou
    Zijun Yang
    Miaomiao Zhu
    He Li
    Seiichi Serikawa
    Mitsunori Mizumachi
    Lifeng Zhang
    Artificial Life and Robotics, 2022, 27 : 568 - 575
  • [8] Keypoint Heatmap Guided Self-Supervised Monocular Visual Odometry
    Xiu, Haixin
    Liang, Yiyou
    Zeng, Hui
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2022, 105 (04)
  • [9] Self-Supervised Deep Pose Corrections for Robust Visual Odometry
    Wagstaff, Brandon
    Peretroukhin, Valentin
    Kelly, Jonathan
    2020 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2020, : 2331 - 2337
  • [10] Self-supervised Visual-LiDAR Odometry with Flip Consistency
    Li, Bin
    Hu, Mu
    Wang, Shuling
    Wang, Lianghao
    Gong, Xiaojin
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 3843 - 3851