Existing adaptive observers may cause the parameter drifts due to disturbances even if state estimation errors remain small. To avoid the drift phenomena in the presence of bounded disturbances, several robust adaptive observers have been introduced addressing bounds in state and parameter estimates. However, it is not easy for these observers to manipulate the size of the bounds with the selection of the observer gain. In order to reduce estimation errors, this paper introduces the (equation omitted) gain minimization problem in the adaptive observer structure, which minimizes the (equation omitted) gain between disturbances and estimation errors. The stability condition of the adaptive observer is reformulated as a linear matrix inequality, and the observer gain is optimally chosen by solving the convex optimization problem. The estimation performance is demonstrated through a numerical example.