Human motion recognition using ultra-wideband radar and cameras on mobile robot

被引:0
作者
Li T. [1 ]
Ge M. [1 ]
机构
[1] School of Electromechanical Engineering, Xidian University
基金
中国国家自然科学基金;
关键词
Computer vision; Human motion; Mobile robot; Pattern recognition; Ultra-wideband radar;
D O I
10.1007/s12209-009-0067-5
中图分类号
学科分类号
摘要
Cameras can reliably detect human motions in a normal environment, but they are usually affected by sudden illumination changes and complex conditions, which are the major obstacles to the reliability and robustness of the system. To solve this problem, a novel integration method was proposed to combine bi-static ultra-wideband radar and cameras. In this recognition system, two cameras are used to localize the object's region, regions while a radar is used to obtain its 3D motion models on a mobile robot. The recognition results can be matched in the 3D motion library in order to recognize its motions. To confirm the effectiveness of the proposed method, the experimental results of recognition using vision sensors and those of recognition using the integration method were compared in different environments. Higher correct-recognition rate is achieved in the experiment. © Tianjin University and Springer-Verlag 2009.
引用
收藏
页码:381 / 387
页数:6
相关论文
共 21 条
[1]  
Yamato J., Ohya J., Ishii K., Recognizing human action in time-sequential images using hidden Markov model, Proc 1992 IEEE Computer Society Conf Computer Vision and Pattern Recognition, pp. 379-385, (1992)
[2]  
Wilson A.D., Bobick A.F., Cassell J., Recovering the temporal structure of natural gesture, Proc 2nd Int Conf Automatic Face and Gesture Recognition, pp. 66-71, (1996)
[3]  
Yang J., Xu Y., Chen C.S., Human action learning via hidden Markov model, IEEE Transactions on Systems, Man, and Cybernetics, 27, 1, pp. 34-44, (1997)
[4]  
Brand M., Oliver N., Pentland A., Coupled hidden markov models for complex action recognition, (1996)
[5]  
Brand M., Oliver N., Pentland A., Coupled hidden Markov models for complex action recognition, Proc 1997 IEEE Computer Society Conf Computer Vision and Pattern Recognition, pp. 994-999, (1997)
[6]  
Wilson A.D., Bobick A.F., Parametric hidden Markov models for gesture recognition, IEEE Transactions on Pattern Analysis and Machine Intelligence, 21, 9, pp. 884-900, (1999)
[7]  
Galata A., Johnson N., Hogg D., Learning behaviour models of human activities, British Machine Vision Conf Modelling Human Behaviour, pp. 12-22, (1999)
[8]  
Galata A., Johnson N., Hogg D., Learning structured behavior models using variable length Markov models, IEEE Int Workshop on Modelling People, pp. 95-102, (1999)
[9]  
Brand M., Kettnaker V., Discovery and segmentation of activities in video, IEEE Transactions on Pattern Analysis and Machine Intelligence, 22, 8, pp. 844-851, (2000)
[10]  
Horvitz E., Oliver N., Garg A., Layered representations for human activity recognition, Proceedings of the 4th IEEE Int Conf Multimodal Interfaces, pp. 3-8, (2002)