A non-local propagation filtering scheme for edge-preserving in variational optical flow computation

被引:5
作者
Dong, Chong [1 ]
Wang, Zhisheng [1 ]
Han, Jiaming [1 ]
Xing, Changda [1 ]
Tang, Shufang [1 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Automat Engn, Nanjing 211100, Peoples R China
关键词
Variational optical flow; Median filtering; Propagation filtering; Edge-preserving; ACCURACY;
D O I
10.1016/j.image.2021.116143
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The median filtering heuristic is considered to be an indispensable tool for the currently popular variational optical flow computation. Its attractive advantages are that outliers reduction is attained while image edges and motion boundaries are preserved. However, it still may generate blurring at image edges and motion boundaries caused by large displacement, motion occlusion, complex texture, and illumination change. In this paper, we present a non-local propagation filtering scheme to deal with the above problem during the coarse-to-fine optical flow computation. First, we analyze the connection between the weighted median filtering and the blurring of image edge and motion boundary under the coarse-to-fine optical flow computing scheme. Second, to improve the quality of the initial flow field, we introduce a non-local propagation filter to reduce outliers while preserving context information of the flow field. Furthermore, we present an optimization combination of non-local propagation filtering and weighted median filtering for the flow field estimation under the coarse-tofine scheme. Extensive experiments on public optical flow benchmarks demonstrate that the proposed scheme can effectively improve the accuracy and robustness of optical flow estimation.
引用
收藏
页数:11
相关论文
共 45 条
[1]   Illumination invariant optical flow using neighborhood descriptors [J].
Ali, Sharib ;
Daul, Christian ;
Galbrun, Ernest ;
Blondel, Walter .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2016, 145 :95-110
[2]   Quantification of Smoothing Requirement for 3D Optic Flow Calculation of Volumetric Images [J].
Bab-Hadiashar, Alireza ;
Tennakoon, Ruwan B. ;
de Bruijne, Marleen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (06) :2128-2137
[3]   A Database and Evaluation Methodology for Optical Flow [J].
Baker, Simon ;
Scharstein, Daniel ;
Lewis, J. P. ;
Roth, Stefan ;
Black, Michael J. ;
Szeliski, Richard .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2011, 92 (01) :1-31
[4]  
Ballester Coloma, 2012, Pattern Recognition. Proceedings Joint 34th DAGM and 36th OAGM Symposium, P31, DOI 10.1007/978-3-642-32717-9_4
[5]  
BERGEN JR, 1992, LECT NOTES COMPUT SC, V588, P237
[6]   The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields [J].
Black, MJ ;
Anandan, P .
COMPUTER VISION AND IMAGE UNDERSTANDING, 1996, 63 (01) :75-104
[7]   High accuracy optical flow estimation based on a theory for warping [J].
Brox, T ;
Bruhn, A ;
Papenberg, N ;
Weickert, J .
COMPUTER VISION - ECCV 2004, PT 4, 2004, 2034 :25-36
[8]   Large Displacement Optical Flow: Descriptor Matching in Variational Motion Estimation [J].
Brox, Thomas ;
Malik, Jitendra .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (03) :500-513
[9]   Lucas/Kanade meets Horn/Schunck: Combining local and global optic flow methods [J].
Bruhn A. ;
Weickert J. ;
Schnörr C. .
International Journal of Computer Vision, 2005, 61 (3) :1-21
[10]   A Naturalistic Open Source Movie for Optical Flow Evaluation [J].
Butler, Daniel J. ;
Wulff, Jonas ;
Stanley, Garrett B. ;
Black, Michael J. .
COMPUTER VISION - ECCV 2012, PT VI, 2012, 7577 :611-625