A new visual tracking scheme is proposed for a mobile robot that tracks a moving object in 3D space in real time. Visual tracking is to control a mobile robot to keep a moving target at the center of input image at all time. We made it possible by simplifying the relationship between the 2D image frame captured by a single camera and the 3D workspace frame. To precisely calculate the input vector (orientation and distance) of the mobile robot, the speed vector of the target is determined by eliminating the speed component caused by the camera motion from the speed vector appeared in the input image. The problem of temporary disappearance of the target form the input image is solved by selecting the searching area based on the linear prediction of target motion. The experimental results have shown that the proposed scheme can make a mobile robot successfully follow a moving target in real time.