In order to obtain a 3-D urban model, an abstraction of the surface model is required. This paper describes works on the 3D reconstruction and modeling by the grouping 3D line segments extracted from the stereo matching of edges, which is derived from multiple images. The grouping is achieved by conditions of degrees and distances between lines. Building objects are determined by the junction combinations of the grouped line segments. The proposed algorithm demonstrates effective results of 3D reconstruction of buildings with 2D aerial images.