The geometric distortion of image is one of the most important parameters that take effect on the accuracy of optical inspection systems. We propose a new correction method of the image distortion to increase the accuracy of PCB inspection systems. The model-free method is applied to correct the randomly distorted image that cannot be represented by mathematical model. To reduce the correction time of inspection system, we newly propose a grid reduction algorithm that minimize the number of grids by the quad-tree approach. We apply the proposed method to a PCB inspection system, and verify its usefulness through experiments using actual inspection images.