In the Third Plenary Session of the 18th Central Committee of the Communist Party of China, general secretary Xi Jin-ping stressed that scientific macro control and effective government governance are the inherent requirements of giving full play to the advantages of the socialist market economic system. In recent years, the rapid development of the large data provides government governance a new way of thinking and new technology. With the support of the development of network information technology, massive, diverse, multi-source and dynamic data will provide new opportunities and challenges for government governance. This paper mainly uses literature analysis and comparative analysis to study how to promote China's government management innovation under the background of big data. Firstly, introduce the research content of the paper. Secondly, analyze the role of big data technology as a tool in government governance innovation. thirdly, elaborate several fields of government governance innovation in the era of big data. finally, analyze the challenges of government governance in the era of large data, and put forward specific opinions. This study has theoretical and practical significance.