Robust optical flow estimation via edge preserving filtering

被引:8
作者
Rao, Sana [1 ]
Wang, Hanzi [1 ]
机构
[1] Xiamen Univ, Sch Informat, Fujian Key Lab Sensing & Comp Smart City, Xiamen 361005, Peoples R China
关键词
Robust optical flow estimation; Motion estimation; Edge-preserving; Weighted guided filtering; NLTV-L-1; model;
D O I
10.1016/j.image.2021.116309
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
It is known that optical flow estimation techniques suffer from the issues of ill-defined edges and boundaries of the moving objects. Traditional variational methods for optical flow estimation are not robust to handle these issues since the local filters in these methods do not hold the robustness near the edges. In this paper, we propose a non-local total variation NLTV-L-1 optical flow estimation method based on robust weighted guided filtering. Specifically, first, the robust weighted guided filtering objective function is proposed to preserve motion edges. The proposed objective function is based on the linear model which is computationally efficient and edge-preserving in complex natural scenarios. Second, the proposed weighted guided filtering objective function is incorporated into the non-local total variation NLTV-L-1 energy function. Finally, the novel NLTV-L-1 optical flow method is performed using the coarse-to-fine process. Additionally, we modify some state-of-the-art variational optical flow estimation methods by the robust weighted guided filtering objective function to verify the performance on Middlebury, MPI-Sintel, and Foggy Zurich sequences. Experimental results show that the proposed method can preserve edges and improve the accuracy of optical flow estimation compared with several state-of-the-art methods.
引用
收藏
页数:10
相关论文
共 41 条
[1]  
Alvarez L., 1999, P 16 CONGRESO ECUACI, P1349
[2]  
[Anonymous], 2009, BMVC
[3]   An Adaptive Approach for the Segmentation and the TV-Filtering in the Optic Flow Estimation [J].
Belhachmi, Z. ;
Hecht, F. .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2016, 54 (03) :358-377
[4]   High accuracy optical flow estimation based on a theory for warping [J].
Brox, T ;
Bruhn, A ;
Papenberg, N ;
Weickert, J .
COMPUTER VISION - ECCV 2004, PT 4, 2004, 2034 :25-36
[5]   A Naturalistic Open Source Movie for Optical Flow Evaluation [J].
Butler, Daniel J. ;
Wulff, Jonas ;
Stanley, Garrett B. ;
Black, Michael J. .
COMPUTER VISION - ECCV 2012, PT VI, 2012, 7577 :611-625
[6]   Fast Adaptive Bilateral Filtering [J].
Gavaskar, Ruturaj G. ;
Chaudhury, Kunal N. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (02) :779-790
[7]   Guided Image Filtering [J].
He, Kaiming ;
Sun, Jian ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (06) :1397-1409
[8]   DETERMINING OPTICAL-FLOW [J].
HORN, BKP ;
SCHUNCK, BG .
ARTIFICIAL INTELLIGENCE, 1981, 17 (1-3) :185-203
[9]   Efficient Coarse-to-Fine PatchMatch for Large Displacement Optical Flow [J].
Hu, Yinlin ;
Song, Rui ;
Li, Yunsong .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :5704-5712
[10]  
Hur J., 2020, Modelling human motion: from human perception to robot design, P119