Similarity Assessment Model for Chinese Sign Language Videos

被引:29
作者
Wang, Li-Chun [1 ]
Wang, Ru [1 ]
Kong, De-Hui [1 ]
Yin, Bao-Cai [1 ]
机构
[1] Beijing Univ Technol, Coll Comp Sci, Beijing Key Lab Multimedia & Intelligent Software, Beijing, Peoples R China
基金
北京市自然科学基金;
关键词
Chinese sign language video; human visual system (HVS); sign language semantic; video similarity assessment; RECOGNITION; EXTRACTION; RETRIEVAL; CLASSIFICATION; ALGORITHM; GESTURES;
D O I
10.1109/TMM.2014.2298382
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a model for measuring similarity between videos which content is Chinese Sign Language (CSL), vision and sign language semantic are considered for the model. Vision component of the model is distance based on Volume Local Binary Patterns (VLBP), which is robust for motion and illumination. Semantic component of the model computes semantic distance based on definition of sign language semantic, which is defined as hand shape, location, orientation and movements. While quantizing the sign language semantic, contour is used to measure shape and orientation; trajectory is used for measuring location andmovement. Experiment results show that proposed assessment model is effective and assessing result given by the model is close to subjective scoring.
引用
收藏
页码:751 / 761
页数:11
相关论文
共 78 条
  • [61] Von Agris U., 2007, Gesture in Human-Computer Interaction and Simulation, P10
  • [62] Isolated ASL sign recognition system for deaf persons
    Waldron, Manjula B.
    Kim, Soowon
    [J]. IEEE Transactions on Rehabilitation Engineering, 1995, 3 (03): : 261 - 271
  • [63] Viewpoint invariant sign language recognition
    Wang, Qi
    Chen, Xilin
    Zhang, Liang-Guo
    Wang, Chunli
    Gao, Wen
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2007, 108 (1-2) : 87 - 97
  • [64] Wang R, 2011, CHINA COMMUN, V8, P139
  • [65] Novel Spatio-Temporal Structural Information Based Video Quality Metric
    Wang, Yue
    Jiang, Tingting
    Ma, Siwei
    Gao, Wen
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2012, 22 (07) : 989 - 998
  • [66] Wang Z, 2003, CONF REC ASILOMAR C, P1398
  • [67] Image quality assessment: From error visibility to structural similarity
    Wang, Z
    Bovik, AC
    Sheikh, HR
    Simoncelli, EP
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (04) : 600 - 612
  • [68] Wang Z., 2001, THESIS U TEXAS AUSTI
  • [69] Digital video quality metric based on human vision
    Watson, AB
    Hu, J
    McGowan, JF
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2001, 10 (01) : 20 - 29
  • [70] Wei W, 2007, CAR C SECUR, P320