Monocular Dense Reconstruction by Depth Estimation Fusion

被引:0
作者
Chen, Tian [1 ,2 ]
Ding, Wendong [1 ,2 ]
Zhang, Dapeng [1 ,2 ]
Liu, Xilong [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Comp & Control Engn, Beijing 100190, Peoples R China
来源
PROCEEDINGS OF THE 30TH CHINESE CONTROL AND DECISION CONFERENCE (2018 CCDC) | 2018年
关键词
Dense reconstruction; Monocular Depth estimation; Depth fusion; GAN; ACCURATE;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Dense and accurate reconstruction plays a fundamental role in mobile robot's environment perception and navigation. It's also necessary for obstacle avoidance and path planning of mobile robots. We propose a method to incrementally reconstruct the scene from monocular sequence by fusing the depth from geometry computation and generative adversarial networks (GAN) prediction. The depth from geometry triangulation is precise but sparse, while the depth from GAN is dense but unsealed. In this paper, we combine the advantages from two methods with a linear model optimized by graph structure. Experiments showed that our proposed method gives precise dense reconstruction in real time,
引用
收藏
页码:4460 / 4465
页数:6
相关论文
共 17 条
[1]  
[Anonymous], 2016, CoRR
[2]  
[Anonymous], 2010, JOINT PATT REC S
[3]  
Concha A, 2015, IEEE INT C INT ROBOT, P5686, DOI 10.1109/IROS.2015.7354184
[4]  
Eigen D, 2014, ADV NEUR IN, V27
[5]   Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecture [J].
Eigen, David ;
Fergus, Rob .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :2650-2658
[6]   Semi-Dense Visual Odometry for a Monocular Camera [J].
Engel, Jakob ;
Sturm, Juergen ;
Cremers, Daniel .
2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, :1449-1456
[7]   Generative Adversarial Networks [J].
Goodfellow, Ian ;
Pouget-Abadie, Jean ;
Mirza, Mehdi ;
Xu, Bing ;
Warde-Farley, David ;
Ozair, Sherjil ;
Courville, Aaron ;
Bengio, Yoshua .
COMMUNICATIONS OF THE ACM, 2020, 63 (11) :139-144
[8]   Accurate and efficient stereo processing by semi-global matching and mutual information [J].
Hirschmüller, H .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, :807-814
[9]  
Ioffe Sergey, 2015, P MACHINE LEARNING R, V37, P448, DOI [DOI 10.48550/ARXIV.1502.03167, DOI 10.5555/3015118.3045167]
[10]  
Long J, 2015, PROC CVPR IEEE, P3431, DOI 10.1109/CVPR.2015.7298965