Traditional maintenance planning is based on a constant maintenance interval for equipment life. In order to consider economic aspect for time based preventive maintenance, preventive maintenance is desirable to be scheduled by RCM(Reliability-Centered Maintenance) evaluation. The main objective of RCM is to reduce the maintenance cost, by focusing on the most important functions of the system and avoiding or removing maintenance actions that are not strictly necessary. So, Markov state model is utilized considering stochastic state in RCM. In this paper, a Markov state model which can be used for scheduling and optimization of maintenance is presented. The deterioration process of system condition is modeled by the stepwise Markov model in detail. Also, because the system is not continuously monitored, the inspection is considered. In case study, simulation results about RCM will be shown using the real historical data of combustion turbine generating unit in Korean power systems.