A Variational Model for Gradient-Based Video Editing

被引:7
作者
Sadek, Rida [1 ]
Facciolo, Gabriele [2 ]
Arias, Pablo [1 ]
Caselles, Vicent [1 ]
机构
[1] Univ Pompeu Fabra, Barcelona 08018, Spain
[2] ENS Cachan, CMLA, F-94235 Cachan, France
关键词
Video editing; Gradient based; Variational methods; OPTICAL-FLOW; REMOVAL;
D O I
10.1007/s11263-012-0597-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this work we present a gradient-based variational model for video editing, addressing the problem of propagating gradient-domain information along the optical flow of the video. The resulting propagation is temporally consistent and blends seamlessly with its spatial surroundings. In addition, the presented model is able to cope with additive illumination changes and handles occlusions/dis-occlusions. The problem of propagation along the optical flow arises in different video editing applications. In this work we consider the application where a user edits a frame by modifying the texture of an object's surface and wishes to propagate this editing throughout the video.
引用
收藏
页码:127 / 162
页数:36
相关论文
共 42 条
[1]  
Adams R., 1985, Sobolev Spaces
[2]  
Agrawal A., 2007, ICCV 07 SHORT COURS
[3]   Symmetrical dense optical flow estimation with occlusions detection [J].
Alvarez, Luis ;
Deriche, Rachid ;
Papadopoulo, Theo .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2007, 75 (03) :371-385
[4]  
Ambrosio L., 2000, OX MATH M, pxviii, DOI 10.1017/S0024609301309281
[5]   A Variational Framework for Exemplar-Based Image Inpainting [J].
Arias, Pablo ;
Facciolo, Gabriele ;
Caselles, Vicent ;
Sapiro, Guillermo .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2011, 93 (03) :319-347
[6]   Sparse Occlusion Detection with Optical Flow [J].
Ayvaci, Alper ;
Raptis, Michalis ;
Soatto, Stefano .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2012, 97 (03) :322-338
[7]   A database and evaluation methodology for optical flow [J].
Baker, Simon ;
Scharstein, Daniel ;
Lewis, J. P. ;
Roth, Stefan ;
Black, Michael J. ;
Szeliski, Richard .
2007 IEEE 11TH INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS 1-6, 2007, :588-595
[8]  
Bhat P., 2007, P ESRT GREN FRANC, P327
[9]   GradientShop: A Gradient-Domain Optimization Framework for Image and Video Filtering [J].
Bhat, Pravin ;
Zitnick, C. Lawrence ;
Cohen, Michael ;
Curless, Brian .
ACM TRANSACTIONS ON GRAPHICS, 2010, 29 (02)
[10]   Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation [J].
Brox, Thomas ;
Malik, Jitendra .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (03) :500-513