Adaptive stabilization of a class of linear systems with matched and unmatched uncertainties is considered in this paper. The proposed controller indeed stabilizes the uncertain system for any positive values of its non-adaptive gain that may be tuned to enhance dynamic response of system. The performance of uncertain system along with the Algebraic Riccati Equation that arises from the adaptive stabilizing controller is now formulated as a multi-objective Linear Matrix Inequality optimization problem. The decay rate and a factor governing the ultimate bound of the system states are considered to characterize the closed loop system performance. Finally, the effectiveness of the proposed controller is illustrated via stabilizing a mass-spring system.