Content-and-disparity-aware stereoscopic video stabilization

被引:0
作者
Shih-Syun Lin
Thi Ngoc Hanh Le
Pang-Yu Wu
Tong-Yee Lee
机构
[1] National Taiwan Ocean University,
[2] National Cheng-Kung University,undefined
来源
Multimedia Tools and Applications | 2021年 / 80卷
关键词
Stabilization; Stereoscopic video; Trajectory; Bézier curve; Optimization;
D O I
暂无
中图分类号
学科分类号
摘要
Filming stereoscopic videos has become easier with the development of science and technology, and such videos now proliferate on the Internet. Meanwhile, video stabilization is an important research topic. Thus, this study presents a method of stabilizing stereoscopic videos with preserving the disparities between objects in the frames. First, the feature points must be tracked and separated into many groups. We posit that the shaky motion is caused not only by translations but also by rotations. Thus, directly smoothing the path will not produce a similar trajectory so that we solve the shakiness of the turning before smoothing the path. To address such shakiness, we initially estimate the rotation angles between two adjacent frames. By determining the angle changes of all the frames, we can find out the preference of rotation in a video. Furthermore, the inconsistent angular velocity can be alleviated and the shakiness of the turning is solved by rotating the frame appropriately. Then, the Bézier curve is utilized to smooth the trajectories. We split a trajectory into a set of subtrajectories and subsequently smooth the latter independently. Unlike previous researches, we split the trajectory according to the feature tracking rate to obtain similar trajectories in the original video path. After making subtrajectories smooth, we merge them to attain a smoothed trajectory. The joint of the two subtrajectories is replaced by their interpolation. Finally, we optimize the smoothness and context preservation to stabilize videos without requiring extensive clipping.
引用
收藏
页码:1545 / 1564
页数:19
相关论文
共 42 条
[1]  
Goferman S(2012)Context-aware saliency detection IEEE Transactions on Pattern Analysis and Machine Intelligence 34 1915-1926
[2]  
Zelnik-Manor L(2012)Video stabilization using epipolar geometry ACM Trans Graph 31 126:1-126:10
[3]  
Tal A(2016)Joint video stitching and stabilization from moving cameras IEEE Trans Image Process 25 5491-5503
[4]  
Goldstein A(2013)Content-aware video retargeting using object-preserving warping IEEE Trans Vis Comput Graph 19 1677-1686
[5]  
Fattal R(2009)Content-preserving warps for 3d video stabilization ACM Trans Graph 28 44:1-44:9
[6]  
Guo H(2011)Subspace video stabilization ACM Trans Graph 30 4:1-4:10
[7]  
Liu S(2013)Bundled camera paths for video stabilization ACM Trans Graph 32 78:1-78:10
[8]  
He T(2006)Full-frame video stabilization with motion inpainting IEEE Transactions on Pattern Analysis and Machine Intelligence 28 1150-1163
[9]  
Zhu S(2013)Spatially and temporally optimized video stabilization IEEE Trans Vis Comput Graph 19 1354-1361
[10]  
Zeng B(2017)A global approach to fast video stabilization IEEE Transactions on Circuits and Systems for Video Technology 27 225-235