In this paper, the fracture toughness evaluation of the various microstructures such as HAZ, F.L and W.M in weldment of TMCP steel which has the softening zone owing to high heat input welding was carried out by using of the small punch(SP) test. In addition, the fracture toughness with the specimen orientation of rolled TMCP steel was investigated by means of SP test and the crack opening displacement (COD) test and then was compared with that of conventional SM50YB steel. From the results of SP test for TMCP steel, it could be seen that the SP energy transition curves of three different orientation were shifted to higher temperature side in order of S, T and L. But the {TEX}$DBTT_{SP}${/TEX} of each orientation specimen did not show a lot of differences and were quite lower than those of conventional SM50YB steel. The mechanical properties of HAZ structure in weldment of TMCP steel such as hardness, SP energy at room temperature and -196$^{circ}C$ and the upper shelf energy of SP energy transition curve were lower than those of base metal due to softening. The {TEX}$DBTT_{SP}${/TEX} of each microstructure in weldment of TMCP steel increased in order of HAZ, F.L and W.M against base metal, but all microstructures showed a quite lower {TEX}$DBTT_{SP}${/TEX} than those of SM50YB steel.