Elastic Functional Coding of Riemannian Trajectories

被引:43
作者
Anirudh, Rushil [1 ,2 ]
Turaga, Pavan [1 ,2 ]
Su, Jingyong [3 ]
Srivastava, Anuj [4 ]
机构
[1] Arizona State Univ, Sch Arts Media & Engn, Tempe, AZ 85281 USA
[2] Arizona State Univ, Dept Elect Comp & Energy Engn, Tempe, AZ 85281 USA
[3] Texas Tech Univ, Dept Math & Stat, Lubbock, TX 79409 USA
[4] Florida State Univ, Dept Stat, Tallahassee, FL 32306 USA
基金
美国国家科学基金会;
关键词
Riemannian geometry; activity recognition; dimensionality reduction; visualization; K-SVD; MOVEMENT; RECOGNITION; MANIFOLDS; FRAMEWORK; VIDEO;
D O I
10.1109/TPAMI.2016.2564409
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Visual observations of dynamic phenomena, such as human actions, are often represented as sequences of smoothly-varying features. In cases where the feature spaces can be structured as Riemannian manifolds, the corresponding representations become trajectories on manifolds. Analysis of these trajectories is challenging due to non-linearity of underlying spaces and high-dimensionality of trajectories. In vision problems, given the nature of physical systems involved, these phenomena are better characterized on a low-dimensional manifold compared to the space of Riemannian trajectories. For instance, if one does not impose physical constraints of the human body, in data involving human action analysis, the resulting representation space will have highly redundant features. Learning an effective, low-dimensional embedding for action representations will have a huge impact in the areas of search and retrieval, visualization, learning, and recognition. Traditional manifold learning addresses this problem for static points in the euclidean space, but its extension to Riemannian trajectories is non-trivial and remains unexplored. The difficulty lies in inherent non-linearity of the domain and temporal variability of actions that can distort any traditional metric between trajectories. To overcome these issues, we use the framework based on transported square-root velocity fields (TSRVF); this framework has several desirable properties, including a rate-invariant metric and vector space representations. We propose to learn an embedding such that each action trajectory is mapped to a single point in a low-dimensional euclidean space, and the trajectories that differ only in temporal rates map to the same point. We utilize the TSRVF representation, and accompanying statistical summaries of Riemannian trajectories, to extend existing coding methods such as PCA, KSVD and Label Consistent KSVD to Riemannian trajectories or more generally to Riemannian functions. We show that such coding efficiently captures trajectories in applications such as action recognition, stroke rehabilitation, visual speech recognition, clustering and diverse sequence sampling. Using this framework, we obtain state-of-the-art recognition results, while reducing the dimensionality/complexity by a factor of 100-250x. Since these mappings and codes are invertible, they can also be used to interactively visualize Riemannian trajectories and synthesize actions.
引用
收藏
页码:922 / 936
页数:15
相关论文
共 50 条
[1]  
Absil PA, 2008, OPTIMIZATION ALGORITHMS ON MATRIX MANIFOLDS, P1
[2]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[3]  
Anirudh R., 2015, INT J COMPUT VISION, P1
[4]  
Anirudh R, 2015, PROC CVPR IEEE, P3147, DOI 10.1109/CVPR.2015.7298934
[5]  
[Anonymous], 1994, USING DYNAMIC TIME W
[6]  
Begelfor Evgeni, 2006, P IEEE C COMP VIS PA, V2, P2087, DOI [DOI 10.1109/CVPR.2006.50, 10.1109/CVPR.2006.50]
[7]   A computational model for redundant human three-dimensional pointing movements: Integration of independent spatial and temporal motor plans simplifies movement dynamics [J].
Biess, Armin ;
Liebermann, Dario G. ;
Flash, Tamar .
JOURNAL OF NEUROSCIENCE, 2007, 27 (48) :13045-13064
[8]  
Chaudhry R, 2009, PROC CVPR IEEE, P1932, DOI 10.1109/CVPRW.2009.5206821
[9]   A Computational Framework for Quantitative Evaluation of Movement during Rehabilitation [J].
Chen, Yinpeng ;
Duff, Margaret ;
Lehrer, Nicole ;
Sundaram, Hari ;
He, Jiping ;
Wolf, Steven L. ;
Rikakis, Thanassis .
2011 INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL MODELS FOR LIFE SCIENCES (CMLS-11), 2011, 1371 :317-326
[10]   The Influence of Visual Motion on Motor Learning [J].
Danziger, Zachary ;
Mussa-Ivaldi, Ferdinando A. .
JOURNAL OF NEUROSCIENCE, 2012, 32 (29) :9859-9869