The object color does not look same under the different light source. It depends on the surface spectral reflectance and the spectral distribution of light source. Therefore we should find the surface spectral reflectance of object color and the spectral distribution of light source for color reproduction. Using Wiener estimation, we can estimate the spectral reflectance from low dimensional images obtained with multi-band image acquisition system. The kind and the number of imaging filters have the effect on the estimation of the spectral reflectance. Therefore it is important that optimal filters are selected to minimize the error of the result. In this paper, we describe methods to select optimal filters with minimum error between measured and estimated surface spectral reflectance and to estimate surface spectral reflectance of Munsell color chart from six multi-band images by using Wiener estimation.