Pixel classification is one of basic issues of image processing. The general characteristics of the pixels belonging to various classes are discussed and the radical principles of pixel classification are given. At the same time, a pixel classification scheme based on image information scales is proposed. The proposed method is overcome that computation amount become greater and contents easily get turned. And image directional scales has excellent anti-noise performance. In the result of experiment. good efficiency is showed compare with other methods.