DeepView: View synthesis with learned gradient descent

被引:302
作者
Flynn, John [1 ]
Broxton, Michael [1 ]
Debevec, Paul [1 ]
DuVall, Matthew [1 ]
Fyffe, Graham [1 ]
Overbeck, Ryan [1 ]
Snavely, Noah [1 ]
Tucker, Richard [1 ]
机构
[1] Google Inc, Mountain View, CA 94043 USA
来源
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019) | 2019年
关键词
D O I
10.1109/CVPR.2019.00247
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a novel approach to view synthesis using multiplane images (MPIs). Building on recent advances in learned gradient descent, our algorithm generates an MPI from a set of sparse camera viewpoints. The resulting method incorporates occlusion reasoning, improving performance on challenging scene features such as object boundaries, lighting reflections, thin structures, and scenes with high depth complexity. We show that our method achieves high-quality, state-of-the-art results on two datasets: the Kalantari light field dataset, and a new camera array dataset, Spaces, which we make publicly available.
引用
收藏
页码:2362 / 2371
页数:10
相关论文
共 37 条
[1]  
ABADI M, 2015, TENSOR FLOW LARGE SC
[2]   Learned Primal-Dual Reconstruction [J].
Adler, Jonas ;
Oktem, Ozan .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) :1322-1332
[3]   Solving ill-posed inverse problems using iterative deep neural networks [J].
Adler, Jonas ;
Oktem, Ozan .
INVERSE PROBLEMS, 2017, 33 (12)
[4]  
Anderson Robert., 2016, Jump: Virtual reality video
[5]  
[Anonymous], P 3 INT C LEARNING R
[6]  
[Anonymous], 2016, CVPR
[7]  
[Anonymous], 2017, CVPR
[8]  
[Anonymous], 2017, NIPS
[9]  
[Anonymous], 2018, CORR
[10]  
[Anonymous], 2015, P INT C LEARN REPR, DOI DOI 10.48550/ARXIV.1511.07289