In vehicular radar servo system, parameter variations of the executive motor and external disturbance uncertainties have great effects on the position tracking precision of the system. In this paper, a robust adaptive controller with disturbance observer is designed for vehicular radar servo system, which combines the merits of disturbance observer, adaptive backstepping method and sliding mode control. The system is modeled, and a disturbance observer is employed to observe and compensate for the unknown uncertainties. Adaptive backstepping method is used to design the sliding model controller to guarantee the global stability of the overall system. Simulation results show that the proposed robust adaptive controller has good performance in position tracking and enhances the robustness of vehicular radar servo system while observing the uncertainties precisely and quickly.