Civil servants, as the users of our public power, play an important role in the process of legal system construction in our country. In reality, the civil servants' legal thinking and ability of rule of law do not completely meet the requirements of rule of law in our country, facing the conflicts between the law and the right, the law and the feeling, the law and the responsibility. This article aims to put forward proposal for upgrading, the civil servants' legal thinking and ability of rule of law through analysis on the problems and reasons of legal thinking and ability of rule of law existing in the civil servants.