In this paper, a method to establish a decision criterion to evaluate the quality of small window motors using sound quality (SQ) metrics is suggested. Although the sound level radiated from the motor is relatively small compared to other sounds in a car, the sound from an abnormal motor gives an uncomfortable feeling and the impression of abnormal operation, which can lead to customer complaints. To construct an objective decision criterion, the correlation between the SQ metrics and the subjective decision on the passing or failure of the motor were investigated. Four representative SQ metrics, viz., loudness, sharpness, roughness, and fluctuation strength, were calculated for the collected samples. It was observed that the loudness and roughness of the motor sample group classified as abnormal was higher than those of the normal motors. For a single figure rating for motor quality, an evaluation index for the motor sound was generated by combining the correlated SQ metrics with proper weightings. Evaluation results on the specimens that were not employed in generating the quality evaluation index showed a reasonable agreement with the subjective test at 73%. The suggested quality check method can replace the current subjective decision procedure to identify the faulty motors.