Automatic tracking of vehicles is important to accurately estimate the traffic information including vehicle speeds in video-based traffic measurement systems. Because of the limited field of view, the range of visual tracking with a single camera is restricted. In order to enlarge the tracking range for better chance of monitoring the vehicle behaviors, a tracking with consecutive multiple video sequences is necessary. This parer proposes a carefully designed rule-based vehicle racking scheme and apply it for the tracking for two well synchronized video sequences. In the scheme, almost all possible cases that can appear in the video-based vehicle tracking are considered to make rules. Also, the rule based scheme is augmented with Kalman filter. The result of tracking can be successfully used to collect data such as temporal variation of vehicle speed and behavior of individual vehicle behaviors in the enlarged tracking region.