The Skutterudite family has become one of the most promising thermoelectric materials because of its interesting crystal structure. Raman scattering spectra of the CoSb3-based Skutterudites were investigated to clarify thermal transport mechanism. An Ag mode was identified through polarization measurements and agreed well with theoretically calculated value. Furthermore, the investigation revealed that only Fe substitution had little effect on the Raman spectra, while La partial filling produced large broadening of the vibrational modes. It is analyzed that this phenomena is mainly due to the rattling motion of the filling atom in crystal voids.