Video stabilization based on low-rank constraint and trajectory optimization

被引:1
作者
Shang, Zhenhong [1 ,2 ]
Chu, Zhishuang [1 ]
机构
[1] Kunming Univ Sci & Technol, Fac Informat Engn & Automat, Kunming, Peoples R China
[2] Kunming Univ Sci & Technol, Yunnan Key Lab Artificial Intelligence, Kunming, Peoples R China
基金
中国国家自然科学基金;
关键词
adaptive filters; computer vision; image enhancement; image registration; motion compensation; motion estimation; video recording; video signal processing;
D O I
10.1049/ipr2.13062
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Video stabilization plays a pivotal role in enhancing video quality by eliminating unwanted jitter in shaky videos. This paper introduces a novel video stabilization algorithm that leverages low-rank constraint and trajectory optimization to effectively eliminate undesirable motion and generate stabilized videos. In the proposed algorithm, a low-rank constraint regularization term is incorporated to enhance the smoothness of motion trajectories. Additionally, a predictive path smoothness term is integrated to ensure the consistency of motion across neighbouring frames. To address the problem of excessive cropping resulting from aggressive smoothing, a flexible local window strategy that emphasizes local motion relationships within the trajectories is introduced. The experimental results show that, compared to other excellent video stabilization algorithms, the proposed algorithm improves the stability metric by approximately 2.3%. Furthermore, in the stabilized videos generated by the algorithm, an approximate improvement of 2.18 dB in average image temporal fidelity and a 5.7% increase in average structural similarity between adjacent frames are achieved. The code that implements the proposed method is publicly accessible at . image
引用
收藏
页码:1768 / 1779
页数:12
相关论文
共 36 条
  • [1] [Anonymous], 2011, Adv Neural Inf Process Syst, DOI DOI 10.48550/ARXIV.1109.0367
  • [2] [Anonymous], Video Figures
  • [3] Boyd S., 2011, FOUND TRENDS MACH LE, V3, P1, DOI DOI 10.1561/2200000016
  • [4] Buehler C, 2001, PROC CVPR IEEE, P609
  • [5] A SINGULAR VALUE THRESHOLDING ALGORITHM FOR MATRIX COMPLETION
    Cai, Jian-Feng
    Candes, Emmanuel J.
    Shen, Zuowei
    [J]. SIAM JOURNAL ON OPTIMIZATION, 2010, 20 (04) : 1956 - 1982
  • [6] Video Stabilization for Strict Real-Time Applications
    Dong, Jing
    Liu, Haibo
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2017, 27 (04) : 716 - 724
  • [7] Re-Cinematography: Improving the Camerawork of Casual Video
    Gleicher, Michael L.
    Liu, Feng
    [J]. ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2008, 5 (01)
  • [8] Video Stabilization Using Epipolar Geometry
    Goldstein, Amit
    Fattal, Raanan
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2012, 31 (05):
  • [9] Grundmann M, 2013, IEEE INT CONF COMPUT
  • [10] Grundmann M, 2011, PROC CVPR IEEE, P225, DOI 10.1109/CVPR.2011.5995525