View-Invariant Full-Body Gesture Recognition from Video

In this paper we propose a video-based full-body gesture recognition system independent of the view angle of the cameras. We performed multilinear analysis on the silhouette images of the static poses making up the gestures by tensor decomposition and projection. Each pair of silhouette images is projected to a view-invariant low dimensional pose coefficient vector space. These pose vectors are then used as input vectors in hidden Markov model (HMM) for gesture recognition. This system worked effectively in our experiments using real videos.