The welded structure unnecessarily remains residual stress due to the very high heating of local region and lastly cooling. The residual stress sometimes causes fracture initiation of welded structures. In this paper, distribution and magnitude of tensile and compressive residual stresses in the TIG(Tungsten Inert Gas) welded aluminum alloy such as Al5083-H112 are measured by using the hole-drilling method. Furthermore, the effects of residual stresses in the TIG welded aluminum CCT(Center Crack Tension) and SEN(Single Edge Notched) Specimens on the fatigue crack propagation behavior are analyzed. The fatigue cracks initiated at residual stresses region are influnced by tensile and compressive residual stresses. However, the effects are found to be released fast for both cases according to the cyclic loads and extension of crack length.