Joint optical flow estimation, segmentation, and 3D interpretation with level sets

被引:13
作者
Sekkati, H. [1 ]
Mitiche, A. [1 ]
机构
[1] INRS, EMT, Montreal, PQ H5A 1K6, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
3D structure; 3D motion; segmentation; optical flow; variational method; level sets;
D O I
10.1016/j.cviu.2005.11.002
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper describes a variational method with active curve evolution and level sets for the estimation, segmentation, and 3D interpretation of optical flow generated by independently moving rigid objects in space. Estimation, segmentation, and 3D interpretation are performed jointly. Segmentation is based on an estimate of optical flow consistent with a single rigid motion in each segmentation region. The method, which allows both viewing system and viewed objects to move, results in three steps iterated until convergence: (a) evolution of closed curves via level sets and, in each region of the segmentation, (b) linear least squares computation of the essential parameters of rigid motion, (c) estimation of optical flow consistent with a single rigid motion. The translational and rotational components of rigid motion and regularized relative depth are recovered analytically for each region of the segmentation from the estimated essential parameters and optical flow. Several examples with real image sequences are provided which verify the validity of the method. (c) 2005 Elsevier Inc. All rights reserved.
引用
收藏
页码:89 / 100
页数:12
相关论文
共 40 条
[2]   ON THE COMPUTATION OF MOTION FROM SEQUENCES OF IMAGES - A REVIEW [J].
AGGARWAL, JK ;
NANDHAKUMAR, N .
PROCEEDINGS OF THE IEEE, 1988, 76 (08) :917-935
[3]  
[Anonymous], 1993, Three-Dimensional Computer Vision: A Geometric Viewpoint
[4]   Computing optical flow via variational techniques [J].
Aubert, G ;
Deriche, R ;
Kornprobst, P .
SIAM JOURNAL ON APPLIED MATHEMATICS, 1999, 60 (01) :156-182
[5]  
Aubert G, 2002, Mathematical problems in image processing: Partial differential equations and the calculus of variations
[6]   Structure from motion:: Beyond the epipolar constraint [J].
Brodsky, T ;
Fermüller, C ;
Aloimonos, Y .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2000, 37 (03) :231-258
[7]  
BRUSS A, 1983, COMPUT GRAPH IMAGE P, P3
[8]  
Chan T, 1999, LECT NOTES COMPUT SC, V1682, P141
[9]  
CHAN T, NOTICES AMS, V50, P14
[10]   Motion competition: A variational approach to piecewise parametric motion segmentation [J].
Cremers, D ;
Soatto, S .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2005, 62 (03) :249-265