3D DRIVER POSE ESTIMATION BASED ON JOINT 2D-3D NETWORK

3D driver pose estimation is a promising and challenging problem for computer-human interaction. Recently convolutional neural networks (CNNs) have been introduced into 3D pose estimation, but these methods have the problem of slow running speed and are not suitable for driving scenario. In this paper, our method is based on two type of inputs, IR image and point cloud obtained from TOF camera. We propose a Joint 2D-3D network incorporating image-based and point-based feature to promote the performance of 3D human pose estimation and run in a high speed. For point cloud with invalid points, we firstly do preprocess and then design a denoising module to handle this problem. Experiments on private Driver dataset and public ITOP dataset show that our method achieves efficient and competitive performance on 3D human pose estimation.