In this paper, we proposed the recognition method that automatically extracts cracks from a surface image acquired by a digital camera and recognizes the directions (horizontal, vertical, -45 degree, and 45 degree) of cracks using the fuzzy single layer perceptron. We compensate an effect of light on a concrete surface image by applying the closing operation, which is one of the morphological techniques, extract the edges of cracks by Sobel masking, and binarize the image by applying the iterated binarization technique. Two times of noise reduction are applied to the binary image for effective noise elimination. After the specific regions of cracks are automatically extracted from the preprocessed image by applying Glassfire labeling algorithm to the extracted crack image, the cracks of the specific region are enlarged or reduced to $30{ imes}30$ pixels and then used as input patterns to the fuzzy single layer perceptron. The experiments using concrete crack images showed that the cracks in the concrete crack images were effectively extracted and the fuzzy single layer perceptron was effective in the recognition of the extracted cracks directions.