Lipreading Using n-Gram Feature Vector

The use of n-grams is quite prevalent in the field of pattern recognition. In this paper, we use this concept to build new feature vectors from extracted parameters to be used for visual speech classification. We extract the lip contour using edge detection and connectivity analysis. The boundary is defined using six cubic curves. The visual parameters are used to build n-gram feature vectors. Two sets of classification experiments are performed with the n-gram feature vectors: using the hidden Markov model and using multiple data mining algorithms in WEKA, a tool widely used by researchers. Preliminary results show encouraging results.