This paper presents a method for real-time estimation of TCSC reference quantity in order to enhance the power system transient stability energy margin using artificial neural network in multi-machine system. This paper has the three parts, the first part is to determine the lines to be installed by TCSC. The seconds is to estimate the energy margin using by ANN. To get the critical energy for training, we use the potential energy boundary surface(PEBS) method which is one of the transient energy function(TEF) method. And the last is to determine the TCSC reference quantity. In order to make training data for ANN in this step, we use genetic algorithm(GA). The proposed method is applied to 39-bus, 46-line. 10-machine model system to show its effectiveness.