As the gradually expanding of the enrollment scale of graduate students and continually deepening of graduate education reform, it is a practical problem for China's higher education to establish the scientific evaluation mechanism of the graduate student so as to effectively guarantee and improve their cultivating quality. Combined with the evaluation situation of the graduate student in recent years, it summarized the current status of the evaluation mechanism of the internal graduate student, and discussed the existed shortcomings of this mechanism. Then, referred to the foreign advantages of the graduate evaluation mechanism, some suggestions are put forward to develop and improve the China's graduate evaluation mechanism.