New combined DT-CWT and HOG descriptor for static and dynamic hand gesture recognition

被引:8
作者
Agab, Salah Eddine [1 ]
Chelali, Fatma Zohra [1 ]
机构
[1] Univ Sci & Technol Houari Boumediene USTHB, Fac Elect Engn, Speech Commun & Signal Proc Lab, Box n 32 El Alia, Algiers 16111, Algeria
关键词
American sign language; Arabic sign language; Artificial neural network; DT-CWT; Gesture recognition; Random Forest; SVM; INDEPENDENT SYSTEM; NEURAL-NETWORKS; CLASSIFICATION; POSTURES; SET;
D O I
10.1007/s11042-023-14433-x
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, researchers have been focusing on developing Human-Computer Interfaces that are fast, intuitive, and allow direct interaction with the computing environment. One of the most natural ways of communication is hand gestures. In this context, many systems were developed to recognize hand gestures using numerous vision-based techniques, these systems are highly affected by acquisition constraints, such as resolution, noise, lighting condition, hand shape, and pose. To enhance the performance under such constraints, we propose a static and dynamic hand gesture recognition system, which utilizes the Dual-Tree Complex Wavelet Transform to produce an approximation image characterized by less noise and redundancy. Subsequently, the Histogram of Oriented Gradients is applied to the resulting image to extract relevant information and produce a compact features vector. For classification, we compare the performance of three Artificial Neural Networks, namely, MLP, PNN, and RBNN. Random Decision Forest and SVM classifiers are also used to ameliorate the efficiency of our system. Experimental evaluation is performed on four datasets composed of alphabet signs and dynamic gestures. The obtained results demonstrate the efficiency of the combined features, for which the achieved recognition rates were comparable to the state-of-the-art.
引用
收藏
页码:26379 / 26409
页数:31
相关论文
共 69 条
[1]  
Adam I, 2010, THESIS POLITEHNICA U
[2]  
Agab SE, 2019, 2019 INT C ADV ELECT, DOI 10.1109/ICAEE47123.2019.9014683
[3]   Recognition of gestures in Arabic sign language using neuro-fuzzy systems [J].
Al-Jarrah, O ;
Halawani, A .
ARTIFICIAL INTELLIGENCE, 2001, 133 (1-2) :117-138
[4]   A systematic literature review on vision based gesture recognition techniques [J].
Al-Shamayleh, Ahmad Sami ;
Ahmad, Rodina ;
Abushariah, Mohammad A. M. ;
Alam, Khubaib Amjad ;
Jomhari, Nazean .
MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (21) :28121-28184
[5]   Gesture Recognition Using Template Based Random Forest Classifiers [J].
Camgoz, Necati Cihan ;
Kindiroglu, Ahmet Alp ;
Akarun, Lale .
COMPUTER VISION - ECCV 2014 WORKSHOPS, PT I, 2015, 8925 :579-594
[6]  
Candrasari Erizka Banuwati, 2019, Journal of Physics: Conference Series, V1367, DOI [10.1088/1742-6596/1367/1/012022, 10.1088/1742-6596/1367/1/012022]
[7]  
CORTES C, 1995, MACH LEARN, V20, P273, DOI 10.1023/A:1022627411411
[8]   Efficient representation of size functions based on moments theory [J].
Dahmani, Djamila ;
Larabi, Slimane ;
Cheref, Mehdi .
MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (19) :27957-27982
[9]   User-independent system for sign language finger spelling recognition [J].
Dahmani, Djamila ;
Larabi, Slimane .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2014, 25 (05) :1240-1250
[10]   Histograms of oriented gradients for human detection [J].
Dalal, N ;
Triggs, B .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :886-893