Pause detection in continuous sign language

被引:6
作者
Khan, Shujjat [1 ]
Bailey, Donald G. [1 ]
Sen Gupta, Gourab [1 ]
机构
[1] Massey Univ, Sch Engn & Adv Technol, Palmerston North, New Zealand
关键词
sign language; segmentation; word localisation; pause; recognition;
D O I
10.1504/IJCAT.2014.063910
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Sign language segmentation breaks a continuous sentence into its basic lexical units by detecting word boundaries. For robust recognition, the majority of direct segmentation approaches exploit these inter-sign pauses in a stream of hand gestures to demarcate word boundaries. Recent attempts to segment a continuous discourse exploit the constancy or directional variations of sign parameters (mainly spatial parameters). The delayed absolute difference (DAD) signature of hand positions provides means for analysing the segmentation features like pauses, repetitions and directional variations in a unique tool. In this paper, a DAD-based pause detection algorithm has been described. The performance of this deterministic algorithm is compared with three segmentation approaches. All the experiments and comparisons are done using the subjective annotation by 15 native New Zealand Sign Language (NZSL) signers. The proposed algorithm correctly and consistently detected the various lengths of pauses as compared to the existing segmentation approaches.
引用
收藏
页码:75 / 83
页数:9
相关论文
共 26 条
[1]   A Unified Framework for Gesture Recognition and Spatiotemporal Gesture Segmentation [J].
Alon, Jonathan ;
Athitsos, Vassilis ;
Yuan, Quan ;
Sclaroff, Stan .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, 31 (09) :1685-1699
[2]   To gesture or not to gesture: What is the question? [J].
Badler, N ;
Costa, M ;
Zhao, LW ;
Chi, D .
COMPUTER GRAPHICS INTERNATIONAL 2000, PROCEEDINGS, 2000, :3-9
[3]  
Brentari D., 2006, 9 THEOR ISS SIGN LAN, P48
[4]  
Chapman B., 2007, USING OPENMP PORTABL
[5]  
Dreuw P., 2010, 4 WORKSH REPR PROC S
[6]  
Dreuw P, 2008, SIXTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, LREC 2008, P1115
[7]  
Fagiani Marco, 2012, Advances in Brain Inspired Cognitive Systems. Proceedings 5th International Conference, BICS 2012, P164, DOI 10.1007/978-3-642-31561-9_18
[8]  
Gao W, 2004, SIXTH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, PROCEEDINGS, P553
[9]  
Gibet S., 2007, GEST WORKSH, P63
[10]   Modelling and segmenting subunits for sign language recognition based on hand motion analysis [J].
Han, Junwei ;
Awad, George ;
Sutherland, Alistair .
PATTERN RECOGNITION LETTERS, 2009, 30 (06) :623-633