With the development and expansion of social economy in our country, the quality of the society is becoming higher and higher. Colleges and universities in China has initially formed a relatively perfect teaching management system, but with the continuous development of higher education. Its existence many problems have been exposed more and more, and ultimately affect the improve the quality of teaching in colleges and universities. Firstly, this paper has combbed the university teaching management system theory and comprehensive quality management theory, then analysed the feasibility of comprehensive quality management mode which was introduced, lastly, discussed the train of thought for constructing the total quality management of teaching in China's universities from the perspective of theory and practice.