This paper deals with problem of determining process target value under automated visual inspection(AVI) system. Three independent error sources - digitizing error, illumination error, and positional error - which have a close relationship with the performance of the AVI system, are considered. Assuming that digitizing error is uniformly or normally distributed and illumination and positional errors are normally distributed, respectively, the distribution function for the error of measured lengths is derived when the length of a product is measured by the AVI system. Then, Optimal target values under two error models of AVI system are obtained by minimizing the total expected cost function which consists of give away, rework and penalty cost. To validate two process setting models, AVI system for drinks filling process is made up and test results are discussed.