Gesture interaction for coronary heart diseases based on wavelet transform and semi-continuous hidden markov model in augmented reality

被引：0
作者：
Gao M. [1 ,2 ]
Chen Y. [1 ]
Zhang D. [1 ,3 ]
Li Z. [1 ,4 ]
Jiang S. [1 ]
Lv S. [1 ]
Lu R. [1 ]
Lu J. [1 ]
Huang C. [1 ]
机构：
[1] School of Computer Engineering and Science, Shanghai University, Shanghai
[2] The 32nd Research Institute, China Electronics Technology Group Corporation, Shanghai City
[3] College of Digital Arts, Shanghai University, Shanghai
[4] Ruijin Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai
来源：
Chen, Yimin (ymchen@mail.shu.edu.cn) | 1600年 / Bentham Science Publishers卷 / 10期
关键词：
Augmented reality; Coronary heart disease; Gesture interaction; Gesture recognition; Semi-continuous hidden markov model; Wavelet transform;
D O I：
10.2174/2352096510666170601123551
中图分类号：
学科分类号：
摘要：
Background: Most doctors are used to locate the vascular stenosis position first then clinically estimate vascular stenosis by the CAG images instead of using mouse, keyboard and computer during the preoperative diagnosis. Therefore, it is necessary to have an effective, intuitive and natural method to replace the existing preoperative diagnosis mode for diagnosing the coronary heart disease. Methods: This work presents the gesture interactive diagnostic method for coronary heart disease based on wavelet transform and Semi-continuous Hidden Markov Model in Augmented Reality. Firstly, the dynamic gesture trajectory is analyzed by using K-means cluster algorithm to determine the gesture trajectory plane. Secondly, the integrity of the trajectory is preserved on the sensor plane by employing trajectory projection and space rotation transformation. Thirdly, the features include the azimuth of gesture trajectory and the changes of hand shape are extracted. Meanwhile, the azimuth of gesture trajectory is analyzed by utilizing wavelet transform and the singularity of the trajectory is detected to compute the state number of SCHMM for all the dynamic gestures. The gesture training is completed by employing Baum-Welch algorithm with multi-features and multi-observation sequences. Ultimately, gesture recognition is realized by using Viterbi algorithm based on self-learning mechanism. It is then applied into the gesture interactive diagnosis of coronary heart disease and the diagnosis of the vascular stenosis are intuitively and naturally realized with augmented reality and gesture interactive techniques. Results: The number of states of dynamic gesture is determined by using wavelet transform which precisely detect singular points of gesture trajectory. The recognition rate of dynamic gesture is average of 96.1% and the semi-dynamic gesture is average of 92.6%, the total recognition rate is average of 95.6%. The dynamic gesture recognition rate of the proposed method is 7% higher than the traditional method. The intuitive and natural gesture interactive experiments and the affirmed measuring results are approved by surgeons. Conclusions: The proposed method is a feasible, usable and reliable gesture interactive diagnostic method for coronary heart disease based on wavelet transform and Semi-continuous Hidden Markov Model in Augmented Reality. The results demonstrate that the proposed method could improve the gesture recognition rate, extend the gesture manipulation space and expand the diagnostic method for coronary heart diseases. © 2017 Bentham Science Publishers.
引用
收藏
页码：150 / 165
页数：15
相关论文
共 46 条
  • [21] Rabiner L.R., A tutorial on hidden Markov models and selected applications in speech recognition, Proc. IEEE, 77, 2, pp. 257-286, (1989)
  • [22] Rose R.C., Discriminant wordspotting techniques for rejecting non-vocabulary utterances in unconstrained speech, Acoustics, Speech Sig. Process., IEEE Inte. Conf. IEEE, pp. 105-108, (1992)
  • [23] Lee S., Jin H.K., Augmenting the discrimination power of HMM by NN for on-line cursive script recognition, Appl. Intell., 7, 4, pp. 305-314, (1997)
  • [24] Khorasani A., Daliri M.R., HMM for classification of Parkinson's disease based on the raw gait data, J. Med. Syst., 38, 12, (2014)
  • [25] Li Z., An adaptive Hidden Markov model for activity recognition based on a wearable multi-sensor device, J. Med. Syst., 39, 5, pp. 1-10, (2015)
  • [26] Chen Y.M., Zhang Y.H., Research on human-robot interaction technique based on hand gesture recognition, Robot, 31, 4, pp. 351-356, (2009)
  • [27] Huang X.D., Jack M.A., Hidden markov modelling of speech based on a semicontinuous model, Electron. Lett., 24, 1, pp. 6-7, (1988)
  • [28] Ge Y., Chen Q., Jiang M., Huang Y., SCHMM-based modeling and prediction of random delays in networked control systems, J. Franklin Institute, 351, 5, pp. 2430-2453, (2014)
  • [29] Rodriguez-Serrano J.A., Perronnin F., A model-based sequence similarity with application to handwritten word spotting, IEEE Transact. Pattern Anal. Machine Intell., 34, 11, pp. 2108-2120, (2012)
  • [30] Lv G., Hu S., Lu X., Speech emotion recognition based on dynamic models, Audio, Lang. Image Process. (ICALIP), 7, pp. 480-484, (2014)
12345