This study investigates the effects of machining parameters as they relate to the quality characteristics of machined features. Two most important quality characteristics are set as the dimensional accuracy and the surface roughness. Before any newly acquired machine tool is put to use for production, it is important to test the machine in a systematic way to find out how different parameter settings affect machining quality. The empirical verification was made by conducting a Design of Experiment (DOE) with 3 levels and 3 factors on a state-of-the-art Cincinnati Hawk Arrow 750 Vertical Machining Center (VMC). Data analysis revealed that the significant factor was the Hardness of the material and the significant interaction effect was the Hardness + Feed for dimensional accuracy, while the significant factor was Speed for surface roughness. Since the equally important thing is the capability of the instruments from which the quality characteristics are being measured, a comparison was made between the VMC touch probe readings and the measurements from a Mi-tutoyo coordinate measuring machine (CMM) on bore diameters. A machine mounted touch probe has gained a wide acceptance in recent years, as it is more suitable for the modern manufacturing environment. The data vindicated that the VMC touch probe has the capability that is suitable for the production environment. The test results can be incorporated in the process plan to help maintain the machining quality in the subsequent runs.