Vibration measurements using image processing have been studied by many researchers as it can remotely measure vibration displacements at multiple points simultaneously. It is difficult, however, to obtain accurate displacement from the measured image signals because the resolution of image data is dependent on camera performance and normally lower than that of vibration transducer directly measured. This paper suggests the enhanced technique for vibration displacement measurement by applying the expected value of edge probability distribution to the varying pixel points in the image. The method can both increase the resolution limit of camera image and decrease the measurement errors. The working performance of the proposed technique is verified applying to the vibration measurement of a rotating machine.