In a long-term experiment established in early 1990, the effects of crop rotation and mineral fertilizers were studied on the maize (Zea mays L.) yield and soil fertility. The results indicated that maize yield increased significantly with N application, and further higher yield was obtained in NP and NPK treatments. The yield averagely increased by 0.69 t/ha, and the yield-increasing effect of crop rotation was more significant in the treatments without fertilizer N (34.2% increase rate, averagely). However, the yield-increasing effect of rotation was diminished with balanced nutrient supply, especially for N. Furthermore, yield stability was improved by balanced nutrient and crop rotation application. Compared with monoculture, soil fertility increased after soybean planting to some extent, whereas crop rotation cannot completely overcome nutrient deficiency when the corresponding mineral nutrient was absent. Consequently, mineral nutrient management and crop rotation should be integrated for the sustainable development of agriculture.