In the recent day, the necessity and the effective usage are increased rapidly, and it is applied in many other fields as well as in the field of ortho-photo map. In this study, we extract each objects on the aerial image and automatically classify graphic information to produce digital map using only digital ortho-image without particular drawing devices for producing digital map. For this purpose, we have applied a lot of the image processing techniques and fuzzy theory, classified outline and lane of road and building, and had each layer according to each feature. Especially, in the case of the building, the outer vector lines extracted by pixel unit at the building were very complex, but we have developed the program to be expressed by I-dimensional linear type between building corners. In the result of this study, we could not extract and recognize all of the object on the image all together, but we have got the error within 50cm using semi-automatic technique. Therefore, this method will be used effectively in producing 1/5,000 digital map.