Adaptive anti-sway and trajectory tracking control of overhead crane is presented, which utilizes Fuzzy Uncertainty Observer(FUO) and Fuzzy based Variable Structure Control(FVSC). We consider an overhead crane system which can be decoupled into the actuated and unactuated subsystems with its own lumped uncertainty such as parameter uncertainties and external disturbance. First, a new method for anti-sway control using FVSC is proposed to improve the conventional method based on Lyapunov direct method, while a conventional trajectory tracking control law using feedback linearization is directly adopted. Second, FUO is designed to estimate one of the two lumped uncertainties which can compensate both of them, based on the fact that two lumped uncertainties are coupled with each other. Then, an adaptive anti-sway control is proposed by incorporating the proposed FVSC and FUO. Under the condition that the observation error is Uniformly Ultimately Bounded(UUB) within an arbitrarily shrinkable region, the overall closed-loop system is shown to be Globally Uniformly Ultimately Bounded(GUUB). In addition, the Global Asymptotic Stability(GAS) of it is shown under the vanishing disturbance assumption. Finally, the effectiveness of the proposed scheme has been confirmed by numerical simulations.