Video Demo: Unsupervised Learning of Depth and Ego-Motion from Cylindrical Panoramic Video

被引:0
作者
Sharma, Alisha [1 ]
Ventura, Jonathan [2 ]
机构
[1] Naval Res Lab, Labs Computat Phys & Fluid Dynam, Washington, DC 20375 USA
[2] Calif Polytech State Univ San Luis Obispo, Dept Comp Sci & Software Engn, San Luis Obispo, CA 93407 USA
来源
2019 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR) | 2019年
基金
美国国家科学基金会;
关键词
computer vision; structure-from-motion; unsupervised learning; panoramic video;
D O I
10.1109/AIVR46125.2019.00059
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this demonstration, we will present a video showing depth predictions for street-level 360 degrees panoramic footage generated using our unsupervised learning model. Panoramic depth estimation is important for a range of applications including virtual reality, 3D modeling, and autonomous robotic navigation. We have developed a convolutional neural network (CNN) model for unsupervised learning of depth and ego-motion from cylindrical panoramic video. In contrast with previous works, we focus on cylindrical panoramic projection. Unlike spherical or cube map projection, cylindrical projection is fully compatible with traditional CNN layers while still supporting a continuous 360 degrees horizontal field of view. We find that this increased field of view improves the ego-motion prediction accuracy for street-level video input. This abstract motivates our work in unsupervised structure-from-motion estimation, describes the video demonstration, outlines our implementation, and summarizes our study conclusions.
引用
收藏
页码:255 / 256
页数:2
相关论文
共 3 条
  • [1] Sharma A., 2019, IEEE C ART INT VIRT
  • [2] Learning Depth from Monocular Videos using Direct Methods
    Wang, Chaoyang
    Miguel Buenaposada, Jose
    Zhu, Rui
    Lucey, Simon
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 2022 - 2030
  • [3] Unsupervised Learning of Depth and Ego-Motion from Video
    Zhou, Tinghui
    Brown, Matthew
    Snavely, Noah
    Lowe, David G.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 6612 - +