This paper proposes the robust matching algorithm of the optical images. To do this, we propose two algorithms, that is, matching algorithms when the silhouette of images is detected and when it is not detected. Also, we propose the method for detecting the matching template and non-matching template from each optical image. And then, optical images are matched according to the coefficient of correlation represented by the similar degree between optical images. Finally, we show the effectiveness and feasibility of the proposed method through some experiments.