High resolution Pan-sharpening technique is becoming increasingly important in the field of remote sensing image analysis as an essential image processing to improve the spatial resolution of original multispectral image. The general scheme of pan-sharpening technique consists of upsampling process of multispectral image and high-pass detail injection process using the panchromatic image. The upsampling process, however, brings about image blurring, and this lead to spectral distortion in the pan-sharpening process. In order to solve this problem, this paper presents a new method that adopts image restoration techniques based on optimization theory in the pan-sharpening process, and evaluates its efficiency and application possibility. In order to evaluate the effect of image restoration techniques on the pansharpening process, the result obtained using the existing method that used bicubic interpolation were compared visually and quantitatively with the results obtained using image restoration techniques. The quantitative comparison was done using some spectral distortion measures for use to evaluate the quality of pan-sharpened image.