With recent advancement of remote sensing technology, a variety of data acquisition over the same area is achievable. An automated co-registration of heterogeneous airborne images is a critical step for change detection. This paper describes an automatic method for co-registration between digital image and existing building model. Optimal building models for co-registration purpose are extracted as primitives from existing building model database. A set of homologous features between straight lines extracted from aerial digital image and model primitive are computed based on geometric similarity function. With obtained homologous features, EO parameter is recomputed using least square method. The result shows that die suggested method automatically co-register two data set in a reliable manner.