LIGHT FIELD DEPTH ESTIMATION EXPLOITING LINEAR STRUCTURE IN EPI

被引:0
作者
Lv, Huijin [1 ]
Gu, Kaiyu [2 ]
Zhang, Yongbing [1 ]
Dai, Qionghai [1 ,3 ]
机构
[1] Tsinghua Univ, Grad Sch Shenzhen, Beijing, Peoples R China
[2] Ningbo Vis 3D Display Technol Co Ltd, Ningbo, Zhejiang, Peoples R China
[3] Tsinghua Univ, Dept Automat, Beijing, Peoples R China
来源
2015 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW) | 2015年
关键词
Light field; epipolar plane image (EPI); depth estimation; occlusion detection;
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Light field (LF), a promising representation to describe the visual appearance of a scene, implicitly captures 3D scene geometry. Inspired by this, we exploit the special linear structure of epipolar plane image (EPI) and propose a novel framework for depth estimation for 4D LF. Our approach estimates disparities through locating the optimal slope of each line segmentation on EPIs, which are projected by corresponding scene points. For each pixel to be processed, we employ intensity pixel value, gradient pixel value, spatial consistency as well as reliability measure to select the best slope from a predefined set. The depth value is calculated according to the geometric relation between disparity and slope of line segmentation in EPI. Then a novel method to detect and handle occlusion boundaries is introduced, further improving the quality of depth maps. We test our algorithm on not only a number of synthetic LF examples but real-world LF datasets, and the experimental results show that our technique outperforms both the state-of-the art and the recent light field stereo matching methods, especially near occlusion boundaries.
引用
收藏
页数:6
相关论文
共 17 条
[1]  
[Anonymous], 2007, CVPR
[2]   EPIPOLAR-PLANE IMAGE-ANALYSIS - AN APPROACH TO DETERMINING STRUCTURE FROM MOTION [J].
BOLLES, RC ;
BAKER, HH ;
MARIMONT, DH .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1987, 1 (01) :7-55
[3]  
Cason J., 2004, POV RAY WINDOWS PERS
[4]  
Chen Can, LIGHT FIELD STEREO M
[5]   Extracting layers and analyzing their specular properties using epipolar-plane-image analysis [J].
Criminisi, A ;
Kang, SB ;
Swaminathan, R ;
Szeliski, R ;
Anandan, P .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2005, 97 (01) :51-85
[6]  
Geiger A, 2011, LECT NOTES COMPUT SC, V6492, P25, DOI 10.1007/978-3-642-19315-6_3
[7]  
Goldluecke B., 2013, VARIATIONAL LIGHT FI
[8]  
Jarabo Adrian, 2014, ACM T GRAPHICS, V33
[9]   Scene Reconstruction from High Spatio-Angular Resolution Light Fields [J].
Kim, Changil ;
Zimmer, Henning ;
Pritch, Yael ;
Sorkine-Hornung, Alexander ;
Gross, Markus .
ACM TRANSACTIONS ON GRAPHICS, 2013, 32 (04)
[10]  
Kolmogorov V, 2002, LECT NOTES COMPUT SC, V2352, P82