This paper proposes the object modeling algorithm using depth data. In order to extract the shape of the object, surface is classified by the magnitude and the direction of Z gradient within the 2x2 mask from input depth data. For the object combined with several primitives is separated by kernel points. Further, spatial relationship between surface regions is extracted for the recognition. Finally, the effectiveness of this algorithm is demonstrated by several experiments.