Despite the increasing interest in web contents and the rapid growth of CMS(Content Management System) market, the studies on the evaluation criteria for determining the purchase of the CMS solution are very rare. We introduce previous researches on the evaluation models of IT solution, and develop new criteria for evaluating CMS solutions. We calculate the relative importance of the evaluation criteria using scores from the IT experts based on the "Pair-wise Comparison" using the AHP. Based on the analyses of IT specialists′ responses, the results of the study show that, among the ten criteria, "the function of content management", "the contribution to the company′s business process" and "the fit with Information Strategic Plan" are the three most important ones over the remaining others. The developed model and criteria for the evaluation of the CMS solutions are expected to contribute on effective purchasing decision of the solutions and their successful implementation.