X-ray point sources observed with the ROSAT High Resolution Imager (HRI) often appear elongated over scales of approximately 5''-10'' from the image core. This elongation has been attributed to errors in the attitude correction as the satellite is wobbled during the observations, and affects sources with both soft and hard X-ray spectra. In this paper, I report the results of an attempt to rid a high signal-to-noise observation of the soft X-ray point source HZ 43 of its characteristic elongation. I divided the observation into 181 separate images, each containing photons from only a small region on the detector through which the source passed during the satellite's wobble. By measuring the positions of the individual image centroids, I found clear evidence for systematic offsets from a common mean by up to approximately +/- 3'' in both right ascension and declination as a function of phase in the satellite wobble. Shifting the subimages to a common center and then restacking them into a single image measurably improved the symmetry of the point-spread function. HRI observations are wobbled primarily to smooth out variations in the pixel-to-pixel sensitivity of the detector and also to extend the lifetime of the microchannel plates in the detector since these decay at a given location as a function of the number of photons detected. However, the elongations introduced by the aspect errors inhibit the identification of possible extended X-ray emission associated with sources such as pulsars and active galactic nuclei. In light of these results, I suggest that until the aspect errors are understood, observations of compact sources, where this effect may be important, should not be wobbled.