Similarity Assessment Model for Chinese Sign Language Videos

被引:29
作者
Wang, Li-Chun [1 ]
Wang, Ru [1 ]
Kong, De-Hui [1 ]
Yin, Bao-Cai [1 ]
机构
[1] Beijing Univ Technol, Coll Comp Sci, Beijing Key Lab Multimedia & Intelligent Software, Beijing, Peoples R China
基金
北京市自然科学基金;
关键词
Chinese sign language video; human visual system (HVS); sign language semantic; video similarity assessment; RECOGNITION; EXTRACTION; RETRIEVAL; CLASSIFICATION; ALGORITHM; GESTURES;
D O I
10.1109/TMM.2014.2298382
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a model for measuring similarity between videos which content is Chinese Sign Language (CSL), vision and sign language semantic are considered for the model. Vision component of the model is distance based on Volume Local Binary Patterns (VLBP), which is robust for motion and illumination. Semantic component of the model computes semantic distance based on definition of sign language semantic, which is defined as hand shape, location, orientation and movements. While quantizing the sign language semantic, contour is used to measure shape and orientation; trajectory is used for measuring location andmovement. Experiment results show that proposed assessment model is effective and assessing result given by the model is close to subjective scoring.
引用
收藏
页码:751 / 761
页数:11
相关论文
共 78 条
  • [1] Visual similarity effects in categorical search
    Alexander, Robert G.
    Zelinsky, Gregory J.
    [J]. JOURNAL OF VISION, 2011, 11 (08):
  • [2] [Anonymous], INT J MACHINE LEARNI
  • [3] [Anonymous], P MIR NOV
  • [4] [Anonymous], 2008, IEEE INT C AUTOMATIC, DOI DOI 10.1109/AFGR.2008.4813472
  • [5] [Anonymous], 2010, P 4 WORKSH REPR PROC
  • [6] A multi-class classification strategy for Fisher scores: Application to signer independent sign language recognition
    Aran, Oya
    Akarun, Lale
    [J]. PATTERN RECOGNITION, 2010, 43 (05) : 1776 - 1788
  • [7] A belief-based sequential fusion approach for fusing manual signs and non-manual signals
    Aran, Oya
    Burger, Thomas
    Caplier, Alice
    Akarun, Lale
    [J]. PATTERN RECOGNITION, 2009, 42 (05) : 812 - 822
  • [8] Ardizzone E., 1996, Proceedings of the 13th International Conference on Pattern Recognition, P135, DOI 10.1109/ICPR.1996.546809
  • [9] Brashear H., 2006, Proceedings of the 8th international ACM SIGACCESS conference on Computers and Accessibility, Assets '06, P79
  • [10] Bungeroth J., 2006, 2nd Workshop on Represent. Processing of Sign Languages, P2000