Several models and methods have been developed to verify the improvement of energy performance in retrofit buildings. The verification is important to confirm the effectiveness of new technologies or retrofits. Inverse model toolkit proposed by ASHRAE evaluates the changes of the energy performance of retrofit buildings by using actual energy consumption data. In this study, the inverse model toolkit was used to analyze heating and cooling energy performance of an office building. Analyzed coefficients of correlation of actual energy consumption with estimated energy consumption was above 0.92 and well fitted. It was confirmed that energy consumption of natural gas decreased by 43.4% and also that electricity decreased by 13.8%, after the retrofit of the case building. For the energy usage, cooling energy was increased by 7.4%, heating energy was decreased by 42.3%, hot water and cooking were increased by 3.4%, lighting and electronics were decreased by 19.3%, and the total energy was decreased by 18.9%.