The realization of the harmonious development between China's central and local governments guarantees the need of the national stability. Nowadays, there are still some disharmonious factors in the current relationship between the central and local governments, for example: the undefined distinction of the responsibility and power between the central and local governments leads to the "displacement" phenomenon and regionalism etc. The following measures proposed by this paper aim to harmonize the relationship between the central and local governments, namely the adjustment of the relationship between China's central and local governments must take our national conditions into consideration, and fully embody Chinese characteristics; deepen the reform of the political system and administrative structure, and realize the separation between party and government, and between government and enterprises; enact "The Central and Local Governments' Relationship Act", or amend "The Local People's Congress at all Levels and the Local Government Organization Act", in order to scientifically define the right and obligation of the central and local governments; Strengthen the authority of the central government and expand the autonomy of the local government; adjust timely relations between local governments at all levels; Strengthen the central government's supervision over local governments; Establish a scientific development view, a correct achievement view, and a scientific Performance Evaluation System for local government officials.