With the development of astrophysics, the astrophysics demands are higher and higher. Astronomical spectral polarization observation can obtain more object information to provide comprehensive data for further research. A polarization imaging spectrometer based on acousto-optic tunable filter was developed for ground-based telescope, which can obtain the image spectral polarization information at the same time. In this paper, first, the work principle of AOTF was introduced, then described the AOTF imaging system for ground-based astronomical observation, it covers the spectral band from 450nm to 900nm. The device can provide about 3.6 degrees view field angle and 10mm aperture, which included TeO2 crystal, image optical system, a charged coupled device(CCD) camera, rf electronics and control and processing software. Finally the paper presented the results of optical design.