Line segment based image registration

This paper proposes a line segment based image registration method. Edges are detected and partitioned into line segments. Line-fitting is applied onto every line segment to rule out those segments of high fitting error. For each segment in a reference image, putative matching segments in a test image are picked with the constraints obtained by analyzing affine transformations. Putative segment correspondences result in the correspondences of intersections of segments, which are used as matching points. An affine matrix is derived from those point correspondences and evaluated by the similarity metric. The segment correspondences ending up with higher similarity metrics are used to compute the final transformation. Experimental results show that the proposed method is robust especially when salient points can not be detected accurately.