The root joint in the welding structures are apt to failure by the stress concentration which is occurred by the external force. Therefore, in the safety and reliability of structure, the complete penetration joint welding which are obtained by the groove welding with edge preparation is generally required. Nevertheless, fillet T-joint welding without edge preparation is often carried out in the fields to reduce working time and consumption of welding electrode, however, this process is likely to produce inadequate joint penetration such as root gap. In this paper, the focus of research is to investigate distribution of welding residual stresses in the plate(or flange) and web of T-joint weld, and especially in the near of root gap notch that is due to incomplete joint penetration. For the analysis, we have chosen model of T-joint weld in the cases of single and multi-pass welding with submerged arc welding and analyzed model by using finite element programs considering the heat conduction and thermal elasto-plastic theory.