A tooth profile modification for loaded gears is used to avoid a tooth impact. Since a tooth profile error causes amplification of the cumbersome whine noise in automotive gear transmissions, an optimal quantity of tooth profile modifications must be obtained for good performance in the vibration sense. In this paper, a tooth profile modification curve considering profile manufacturing errors and elastic deformation of the gear tooth is formulated; in addition, transmission errors of the gear system with modified teeth are verified. The equivalent excitation due to transmission errors is formulated. For experimental evaluation of the transmission error, the transmission error for a simple gear system was measured by two rotational laser vibrometers. Finally, we perform a comparative analysis between the calculated and measured responses to the excitations due to the transmission error to verify the practicability of the application to automotive transmissions.