Video pose estimation with global motion cues

被引:7
|
作者
Shi, Qingxuan [1 ,2 ]
Di, Huijun [1 ]
Lu, Yao [1 ]
Lv, Feng [1 ]
Tian, Xuedong [2 ]
机构
[1] Beijing Inst Technol, Sch Comp Sci, Beijing Lab Intelligent Informat Technol, Beijing, Peoples R China
[2] Hebei Univ, Sch Comp Sci & Technol, Baoding, Peoples R China
基金
中国国家自然科学基金; 高等学校博士学科点专项科研基金;
关键词
Pose estimation; Pose detection; Global motion estimation; PICTORIAL STRUCTURES;
D O I
10.1016/j.neucom.2016.09.033
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper addresses the problem of pose estimation in video sequences in which human pose changes drastically over time. Popular strategies for video pose estimation first yield multiple pose candidates for each frame and then achieve consistent pose estimation by enforcing temporal constraints across frames. To enrich pose candidates, previous methods typically employ local motion cues to propagate pose detections to adjacent frames. Reasonable pose proposals can be achieved only when the local motion estimation is accurate and good detections exist among adjacent frames, both of which are hard to be satisfied under drastic human pose changes. In this paper, we propose to propagate pose detections to entire video sequence through global motion cues which provide a long term holistic non-rigid motion transformation for the given video. We exploit the temporal continuity of both single parts and part pairs in the inference over a spa-do-temporal model to stitch the reasonable trajectory fragments for each part and obtain the final pose estimation. Experimental results demonstrate remarkable performance improvement in comparison with the state-of-the-art methods.
引用
收藏
页码:269 / 279
页数:11
相关论文
共 50 条
  • [1] HUMAN POSE ESTIMATION WITH GLOBAL MOTION CUES
    Shi, Qingxuan
    Di, Huijun
    Lu, Yao
    Lv, Feng
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 442 - 446
  • [2] Global motion estimation for video stabilization
    Department of Electronic Engineering, Tsinghua University, Beijing 100084, China
    Qinghua Daxue Xuebao, 2007, 1 (92-95):
  • [3] Global motion estimation algorithm for video segmentation
    Sáez, E
    Palomares, JM
    Benavides, JI
    Guil, N
    VISUAL COMMUNICATIONS AND IMAGE PROCESSING 2003, PTS 1-3, 2003, 5150 : 1540 - 1550
  • [4] Camera pose estimation based on global structure from motion
    Dan Li
    Danya Song
    Shuang Liu
    Junwen Ji
    Kang Zeng
    Yingsong Hu
    Hefei Ling
    Multimedia Tools and Applications, 2020, 79 : 23223 - 23242
  • [5] Camera pose estimation based on global structure from motion
    Li, Dan
    Song, Danya
    Liu, Shuang
    Ji, Junwen
    Zeng, Kang
    Hu, Yingsong
    Ling, Hefei
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (31-32) : 23223 - 23242
  • [6] Global motion estimation and robust regression for video coding
    Zhang, K
    Kittler, J
    PROCEEDINGS OF THE 1998 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-6, 1998, : 2589 - 2592
  • [7] A novel predictive global motion estimation for video coding
    Chan, WC
    Au, OC
    Fu, MF
    2002 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL III, PROCEEDINGS, 2002, : 5 - 8
  • [8] Improved global motion estimation via motion vector clustering for video stabilization
    Chen, Bo-Hao
    Kopylov, Andrey
    Huang, Shih-Chia
    Seredin, Oleg
    Karpov, Roman
    Kuo, Sy-Yen
    Lai, K. Robert
    Tan, Tan-Hsu
    Gochoo, Munkhjargal
    Bayanduuren, Damdinsuren
    Gong, Cihun-Siyong
    Hung, Patrick C. K.
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2016, 54 : 39 - 48
  • [9] Robust global motion estimation oriented to video object segmentation
    Qi, Bin
    Ghazal, Mohammed
    Amer, Aishy
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2008, 17 (06) : 958 - 967
  • [10] Fusion of Global and Local Motion Estimation for Distributed Video Coding
    Abou-Elailah, Abdalbassir
    Dufaux, Frederic
    Farah, Joumana
    Cagnazzo, Marco
    Pesquet-Popescu, Beatrice
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2013, 23 (01) : 158 - 172