Significant improvements in the switching voltage distribution are required for the development of unipolar resistive memory devices using $MnO_x$ thin films. The $V_{set}$ of the as-grown $MnO_x$ film ranged from 1 to 6.2 V, whereas the $V_{set}$ of the oxygen-annealed film ranged from 2.3 to 3 V. An excess of oxygen in an $MnO_x$ film leads to an increase in $Mn^{4+}$ content at the $MnO_x$ film surface with a subsequent change in the $Mn^{4+}/Mn^{3+}$ ratio at the surface. This was attributed to the change in $Mn^{4+}/Mn^{3+}$ ratios at the $MnO_x$ surface and to grain growth. Oxygen annealing is a possible solution for improving the switching voltage distribution of $MnO_x$ thin films. In addition, crystalline $MnO_x$ can help stabilize the $V_{set}$ and $V_{reset}$ distribution in memory switching in a Ti/$MnO_x$/Pt structure. The improved uniformity was attributed not only to the change of the crystallinity but also to the redox reaction at the interface between Ti and $MnO_x$.