Sign Language Phoneme Transcription with Rule-based Hand Trajectory Segmentation

被引:11
|
作者
Kong, W. W. [1 ]
Ranganath, Surendra [1 ]
机构
[1] Natl Univ Singapore, Dept Elect & Comp Engn, Singapore 117576, Singapore
来源
JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY | 2010年 / 59卷 / 02期
关键词
American sign language (ASL); Phoneme transcription; Trajectory segmentation; Principal component analysis (PCA); Hidden Markov models (HMM);
D O I
10.1007/s11265-008-0292-5
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A common approach to extract phonemes of sign language is to use an unsupervised clustering algorithm to group the sign segments. However, simple clustering algorithms based on distance measures usually do not work well on temporal data and require complex algorithms. In this paper, we present a simple and effective approach to extract phonemes from American sign language sentences. We first apply a rule-based segmentation algorithm to segment the hand motion trajectories of signed sentences. We then extract feature descriptors based on principal component analysis to represent the segments efficiently. The segments are clustered by k-means using these high level features to derive phonemes. 25 different continuously signed sentences from a deaf signer were used to perform the analysis. After phoneme transcription, we trained Hidden Markov Models to recognize the sequence of phonemes in the sentences. Overall, our automatic approach yielded 165 segments, and 58 phonemes were obtained based on these segments. The average number of recognition errors was 18.8 (11.4%). In comparison, completely manual trajectory segmentation and phoneme transcription, involving considerable labor yielded 173 segments, 57 phonemes, and the average number of recognition errors was 33.8 (19.5%).
引用
收藏
页码:211 / 222
页数:12
相关论文
共 50 条
  • [21] RULE-BASED SEGMENTATION OF MULTIDIMENSIONAL MEDICAL IMAGES
    RAYA, SP
    NCGA 89 CONFERENCE PROCEEDINGS, VOLS 1-3, 1989, : A193 - A198
  • [22] Rule-based automatic segmentation of color images
    Demirci, Recep
    AEU-INTERNATIONAL JOURNAL OF ELECTRONICS AND COMMUNICATIONS, 2006, 60 (06) : 435 - 442
  • [23] An improved fuzzy rule-based segmentation system
    Hachouf, F
    Mezhoud, N
    SEVENTH INTERNATIONAL SYMPOSIUM ON SIGNAL PROCESSING AND ITS APPLICATIONS, VOL 1, PROCEEDINGS, 2003, : 533 - 536
  • [24] A trainable rule-based algorithm for word segmentation
    Palmer, DD
    35TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS AND THE 8TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE CONFERENCE, 1997, : 321 - 328
  • [25] Rule-based model of bacterial transcription initiation
    Sorokin, A.
    Temlyakova, E.
    FEBS JOURNAL, 2013, 280 : 569 - 569
  • [26] An expressive and tractable rule-based description language
    Linh Anh Nguyen
    Ngoc-Thanh Nguyen
    ENTERPRISE INFORMATION SYSTEMS, 2019, 13 (7-8) : 1069 - 1093
  • [27] A rule-based extension to the C++ language
    Mulvaney, D
    Bristow, C
    SOFTWARE-PRACTICE & EXPERIENCE, 1997, 27 (07): : 747 - 761
  • [28] Automatic Hand Gesture Segmentation for Recognition of Vietnamese Sign Language
    Duc-Hoang Vo
    Huu-Hung Huynh
    Thanh-Nghia Nguyen
    Meunier, Jean
    PROCEEDINGS OF THE SEVENTH SYMPOSIUM ON INFORMATION AND COMMUNICATION TECHNOLOGY (SOICT 2016), 2016, : 368 - 373
  • [29] Chromar, a Rule-based Language of Parameterised Objects
    Honorato-Zimmer, Ricardo
    Millar, Andrew J.
    Plotkin, Gordon D.
    Zardilis, Argyris
    ELECTRONIC NOTES IN THEORETICAL COMPUTER SCIENCE, 2018, 335 : 49 - 66
  • [30] A Trace Query Language for Rule-Based Models
    Laurent, Jonathan
    Medina-Abarca, Hector F.
    Boutillier, Pierre
    Yang, Jean
    Fontana, Walter
    COMPUTATIONAL METHODS IN SYSTEMS BIOLOGY (CMSB 2018), 2018, 11095 : 220 - 237