In this paper, we propose the method that extracts sea level measurements graph from the sea level measurements recording paper image with a little interaction. At first, a pixel that is included in the graph area is selected. Then, background pixels are automatically determined using the distance between a selected pixel and other pixels on LAB color space. In each vertical line, a pixel that is the nearest to the selected pixel on LAB color space is extracted and the graph area is determined using that pixels. Experimental results show that the sea level measurements graph can be extracted with a few interaction from the various sea level measurements recording paper images.