In this paper, a simple optical method that uses an infrared(IR) cut filter is proposed to minimize variation of eye image by external infrared(IR) sources in a video based head mounted eye tracking system that is used in the field of sports. For this, the IR cut filter is attached to a head mount of the eye tracking system, and the camera with an IR LED is located between the IR cut filter and eye. In this structure, external IR is blocked by the IR cut filter, and the IR intensity on the eye can be controlled by the IR LED. Therefore, the illumination condition of the camera to capture the eye can be stable without being affected by external IR illuminations. To verify the proposed idea, variation of the eye image and intensity of the IR with/without the IR cut filter is measured under various illumination conditions. The measured data show that the IR cut filter method can block external IR effectively, and complex pupil detection algorithms can be replaced by a simple binarized method.