Speed Up Light Field Synthesis from Stereo Images

被引:2
作者
Chen, Yi-Chou [1 ]
Chao, Chun-Hao [1 ]
Liu, Chang-Le [1 ]
Shih, Kuang-Tsu [1 ]
Chen, Homer H. [1 ]
机构
[1] Natl Taiwan Univ, Grad Inst Commun Engn, Taipei, Taiwan
来源
2021 4TH IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR 2021) | 2021年
关键词
light field synthesis; light field reconstruction; stereo vision; CNN; deep learning;
D O I
10.1109/AIVR52153.2021.00016
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we focus on the speedup of a learning-based light field synthesis pipeline. The pipeline involves a disparity estimation neural network and a light field blending component. The former achieves high speed performance through the use of feature extraction and multi-stage disparity refinement, while the latter warps and merges coarse light fields generated from the left and right disparity maps in a novel and efficient way. The pipeline can produce a full light field in less than 1/10 of a second, while retaining fairly reasonable image quality. The model itself has a very low parameter count, which is ideal for devices with limited computational power.
引用
收藏
页码:47 / 53
页数:7
相关论文
共 25 条
[1]  
[Anonymous], INRIA Light field dataset
[2]  
[Anonymous], 4D Light Field Benchmark
[3]  
Chao C.-H., 2021, PROC IEEE INT C IMAG
[4]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448
[5]   Single Image Depth Estimation Trained via Depth from Defocus Cues [J].
Gur, Shir ;
Wolf, Lior .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :7675-7684
[6]  
Huang F.-C., 2015, P C SIGGRAPH EM TECH
[7]   LiteFlowNet: A Lightweight Convolutional Neural Network for Optical Flow Estimation [J].
Hui, Tak-Wai ;
Tang, Xiaoou ;
Loy, Chen Change .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8981-8989
[8]   Learning-Based View Synthesis for Light Field Cameras [J].
Kalantari, Nima Khademi ;
Wang, Ting-Chun ;
Ramamoorthi, Ravi .
ACM TRANSACTIONS ON GRAPHICS, 2016, 35 (06)
[9]   End-to-End Learning of Geometry and Context for Deep Stereo Regression [J].
Kendall, Alex ;
Martirosyan, Hayk ;
Dasgupta, Saumitro ;
Henry, Peter ;
Kennedy, Ryan ;
Bachrach, Abraham ;
Bry, Adam .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :66-75
[10]  
King DB, 2015, ACS SYM SER, V1214, P1, DOI 10.1021/bk-2015-1214.ch001