The temperature distributions of concrete structures strongly depend on the value of thermal conductivity of concrete. However, the thermal conductivity of concrete varies according to the composition of the constituents and the temperature and moisture conditions of concrete, which cause difficulty in accurately predicting the thermal conductivity value in concrete. For this reason, in this study, back-propagation neural network models on the basis of experimental values carried out by previous researchers have been utilized to effectively account for the influence of these variables. The neural networks were trained by 124 data sets with eleven parameters: nine concrete composition parameters (the ratio of water-cement, the percentage of fine and coarse aggregate, and the unit weight of water, cement, fine aggregate, coarse aggregate, fly ash and silica fume) and two concrete state parameters (the temperature and water content of concrete). Finally, the trained neural network models were evaluated by applying to other 28 measured values not included in the training of the neural networks. The result indicated that the proposed method using a back-propagation neural algorithm was effective at predicting the thermal conductivity of concrete.