The reform of education and teaching in colleges and universities from the perspective of sociology of language is conducive to improving the students' language skills and interpersonal skills and training more talents with high quality who are suitable for the needs of social enterprises. Therefore, based on the research of domestic scholars on the reform of education and teaching in colleges and universities, this paper uses the methods of literature materials and logical reasoning to analyze the causes and main viewpoints of the sociology of language. Then the paper discusses the main problems in the reform of education and teaching in colleges and universities in China, including over-emphasis on the cultivation of students' professional knowledge and skills, backward teaching ideas and methods, the lack of academic exchanges. Finally, from the aspects of clearing the social goals, strengthening the theory teaching of linguistics, innovating the teaching methods etc., it proposes new ways of education and teaching reform in colleges and universities, in order to improve the overall quality of education and teaching in colleges and universities.