Generally the traditional optimization methods have possibilities not only to give a different optimum value according to their starting point, but also to get to local optima. On the other hand, Genetic Algorithm (GA) has an ability of robust global search. In this paper, a new optimization method - the combination of traditional optimization method and genetic algorithm - is presented so as to overcome the above disadvantage of traditional methods. In order to increase the efficiency of the hybrid optimization method, a knowledge-based reasoning is adopted in the part of mathematical modeling, algorithm selection, and process control. The validation of the developed knowledge-based hybrid optimization method was examined and verified applying the method to nonlinear mathematical models.