This paper proposed a sub-pixel image correlation algorithm that can get more Precise result, its principle is apply the distribute of relativity peak to get weighted multi-pixel comprehensive of location. Image correlation be as to calculates the greyscale relativity of image template and matching image, the relativity of correspond location where match best with template will be most high, and in its neighbour range, the relativity will be still keep high too. We used these pixel in this local area of calculated match point to get sub-pixel accuracy, the relativity of every pixel be used as its weight for participate the sub-pixel calculation. The sub-pixel location is more accuracy than the integer one, we applied this method to perform background compensation in processing the target detecting for video image sequence. At the end of this paper, some experiment data be proposed, it proved this sub-pixel image correlation can obtain better result.