The purpose of this paper is to design and implement the user motion pattern control system for the simulated vehicle. After analyzing the user motion patterns in the system, the patterns are used to control the moving direction of the simulated vehicle such as forward, backward, turn right, turn left etc. The patterns in the system around are sent to the simulated vehicle in real time. In order to execute the suggested user motion pattern control system, the Kinect is used for executing the system. The Kinect recognizes the specified user motion patterns and it transmits the data to the user motion pattern control system. There are nine kinds of the user motion patterns in the system for controlling the simulated vehicle. In addition to this, some sensors are used to detect the condition of the simulated vehicle. GPS is also used to estimate the current location of the simulated vehicle and to obtain the driving information.