Self-supervised Depth Estimation based on Feature Sharing and Consistency Constraints

被引:1
作者
Mendoza, Julio [1 ]
Pedrini, Helio [1 ]
机构
[1] Univ Estadual Campinas, Inst Comp, BR-13083852 Campinas, SP, Brazil
来源
PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 5: VISAPP | 2020年
基金
巴西圣保罗研究基金会;
关键词
Depth Estimation; Self-supervised Learning; Multi-task Learning; Consistency Constraints;
D O I
10.5220/0008975901340141
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this work, we propose a self-supervised approach to depth estimation. Our method uses depth consistency to generate soft visibility mask that reduces the error contribution of inconsistent regions produced by occlusions. In addition, we allow the pose network to take advantage of the depth network representations to produce more accurate results. The experiments are conducted on the KITTI 2015 dataset. We analyze the effect of each component in the performance of the model and demonstrate that the consistency constraint and feature sharing can effectively improve our results. We show that our method is competitive when compared to the state of the art.
引用
收藏
页码:134 / 141
页数:8
相关论文
共 28 条
[1]  
Almalioglu Y, 2019, IEEE INT CONF ROBOT, P5474, DOI [10.1109/icra.2019.8793512, 10.1109/ICRA.2019.8793512]
[2]  
[Anonymous], 2017, P IEEE C COMP VIS PA
[3]  
Casser V, 2019, AAAI CONF ARTIF INTE, P8001
[4]  
Chen Y., 2019, ARXIV190705820
[5]   Multi-Stream Convolutional Neural Networks for Action Recognition in Video Sequences Based on Adaptive Visual Rhythms [J].
Concha, Darwin Ttito ;
Maia, Helena de Almeida ;
Pedrini, Helio ;
Tacon, Hemerson ;
Brito, Andre de Souza ;
Chaves, Hugo de Lima ;
Vieira, Marcelo Bernardes .
2018 17TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2018, :473-480
[6]   Multi-task Self-Supervised Visual Learning [J].
Doersch, Carl ;
Zisserman, Andrew .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2070-2079
[7]  
Eigen D, 2014, ADV NEUR IN, V27
[8]   Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue [J].
Garg, Ravi ;
VijayKumar, B. G. ;
Carneiro, Gustavo ;
Reid, Ian .
COMPUTER VISION - ECCV 2016, PT VIII, 2016, 9912 :740-756
[9]   Unsupervised Monocular Depth Estimation with Left-Right Consistency [J].
Godard, Clement ;
Mac Aodha, Oisin ;
Brostow, Gabriel J. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6602-6611
[10]  
Gordon A., 2019, ARXIV190404998