Review of Sign Language Recognition Based on Deep Learning

被引:9
|
作者
Zhang Shujun [1 ]
Zhang Qun [1 ]
Li Hui [1 ]
机构
[1] Qingdao Univ Sci & Technol, Coll Informat Sci & Technol, Qingdao 266061, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Sign language recognition; Convolutional Neural Network (CNN); Recurrent Neural Network (RNN); Long-term temporal sequence modeling; CORPUS; VIDEO;
D O I
10.11999/JEIT190416
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Sign language recognition involves computer vision, pattern recognition, human-computer interaction, etc. It has important research significance and application value. The flourishing of deep learning technology brings new opportunities for more accurate and real-time sign language recognition. This paper reviews the sign language recognition technology based on deep learning in recent years, formulates and analyzes the algorithms from two branches - isolated words and continuous sentences. The isolated-word recognition technology is divided into three structures: Convolutional Neural Network (CNN), Three-Dimensional Convolutional Neural Network (3D-CNN) and Recurrent Neural Network (RNN) based method. The model used for continuous sentence recognition has higher complexity and is usually assisted with certain kind of long-term temporal sequence modeling algorithm. According to the major structure, there are three categories: the bidirectional LSTM, the 3D convolutional network model and the hybrid model. Common sign language datasets at home and abroad are summarized. Finally, the research challenges and development trends of sign language recognition technology are discussed, concluding that the robustness and practicality on the premise of high-precision still requires to be promoted.
引用
收藏
页码:1021 / 1032
页数:12
相关论文
共 69 条
  • [1] [Anonymous], WORKSH EUR C COMP VI
  • [2] [Anonymous], 6 INT C FICTA SING
  • [3] [Anonymous], ECCV WORKSH
  • [4] [Anonymous], APPL AM SIGN LANGUAG
  • [5] [Anonymous], 2012, PROC 5 WORKSHOP REPR
  • [6] [Anonymous], 2018, P IEEE C COMP VIS PA
  • [7] [Anonymous], 2017, P IEEE C COMP VIS PA
  • [8] [Anonymous], SIGN LANGUAGE RECOGN
  • [9] [Anonymous], SPIE
  • [10] [Anonymous], 2018, IJCAI