Automatic Segmentation of Human Depth Map Based on Semantic Segmentation of FCN and Depth Segmentation

Traditional 3D information acquisition of human body relies on either foreground extraction or threshold segmentation in a plain background. It is difficult to be applied directly in complex background. In this paper, a novel method is proposed on the basis of binocular vision, which combines the semantic segmentation of FCN with the depth segmentation to get the human body depth map. The depth map is obtained by binocular camera, and each point in the depth map corresponds to the point in the left camera image. The position of the human body is gained through semantic segmentation of the left camera image, then automatic depth segmentation can be conducted based on the depth of human body in the depth map. The final result is obtained by taking the intersection of the depth map segmentation result and the left camera image segmentation result. The results show that the segmentation precision is much higher than that of purely semantic segmentation of FCN, the segmentation accuracy has increased about 2%.