For precise tracking control of a servo system with nonlinear friction, a robust friction compensation scheme is presented in this paper. The nonlinear friction is difficult to identify the friction parameters exactly through experiments. Friction parameters can be also varied according to contact conditions such as the variation of temperature and lubrication. Thus, in order to overcome these problems and obtain the desired position tracking performance, a robust adaptive back-stepping control scheme with a dual friction observer is developed. In addition, to estimate lumped friction uncertainty due to modeling errors, a DEKF recurrent neural network and adaptive reconstructed error estimator are also developed. The feasibility of the proposed control scheme is verified through the experiment fur a ball-screw system.