With the rapid development of domestic manufacturing technology, the continuous improvement of domestic economy and the continuous increase of people's comprehensive income, people pay more and more attention to their own health and with the help and support of the national government, the medical device industry has developed into a sunrise industry, there are lots of medical device enterprises and medical institutions in China. Therefore, designing the essential part of medical devices for surgical treatment, namely, operating table will be essential for improving the medical levels. Hence, this paper proposes the novel smart operating table based on HCI and virtual visual tracking technology. The highlights of the paper contains: (1) Compared with traditional industrial robots, surgical robots require higher control accuracy and stability, and also require larger workspace, faster response speed and good flexibility, our designed model uses the HCI to add the interactive concerns to the traditional methods. (2) The designed intelligent operating table replaces doctors to perform many operations, which reduces the manpower, material resources and financial resources. The proposed virtual visual tracking technology can improve the overall performance of the idea. We designed the model from different perspectives and conduct the simulation analysis with the comparison modelling. The results have shown that the designed model is efficient, we use the OpenCV library to program in C + + on vs2015, to tes the proposed model, we verify the accuracy of the user's head pose by experiments and compares different methods, it can be seen from the experiment, the tracking accuracy is more than 10% than the taditional methods.