This paper proposes the robust matching algorithm for optical images obtained by WSI(White-light Scanning Interferometer) machine. The matching algorithms are divided by two part according to the matching points: algorithm whether the matching points between two images exist or not. Also, after matching the images, we propose the algorithm to smooth the matched image. Finally, we show the effectiveness and feasibility of the proposed method through some experiments.