We have spectrally resolved the photoluminescence of InP quantum dots exhibiting random telegraph noise. In particular, we have investigated dots switching among three different levels. We find no spectral shift of the emission in the different states, only a modulation of the Intensity. Temperature-dependent experiments show that phonons are important in the process.