The rail surface defects can cause the high impact load on the track and lead to the progress of the rail fatigue damage and the rail break. In case of the rail break, there is a great deal of risk for derailment, and thus the maintenance criteria for the rail surface defects are of great importance. In this study, using the dynamic train-track interaction analysis program, the impact wheel loads and rail bending stresses according to the depths of the surface defects have been calculated with the input data of the rail surface irregularities measured at 43 spots with surface defects in the ballasted track of high-speed railway. Considering the irregularity of track geometry, the allowable limits of wheel load and rail bending stress have been set, and the maintenance criteria for the rail surface defects was suggested by analyzing the relationship of the maximum values of wheel load and rail bending stress versus depth and width of rail surface defect. The analysis results suggest that the allowable depth of the surface defect is determined approximately 0.2mm from the limit of the impact wheel load.