Occlusion and poor feature point detection are two main difficulties in the use of multiple frames for establishing correspondence of feature points. A new formulation of the correspondence problem as an optimisation problem is discussed to handle these difficulties. Modifications to an existing iterative optimization procedure are discussed to solve the new formulation of the correspondence problem. Experimental results are presented to show the merits of the new formulation. © 1990 IEEE.