This paper presents a tracking vibration estimation system of the track-following system using a tracking loop gain adjustment algorithm and a genetic algorithm. The algorithms are introduced to estimate accurately the tracking vibration quantity in spite of the uncertainties of the tracking actuator. An estimated actuator model can be found by applying a genetic algorithm. Accordingly, the tracking vibration quantity can be estimated from the measured tracking error, the tracking controller and the estimated actuator model. The proposed tracking vibration estimation method is applied to the track-following system of an optical recording device and is evaluated through the experimental result.