Generally, stress relief annealing and vibrational stress relief used to remove the residual stress in welded joint which exerts a vicious influence upon welded structural members. The objective of this study is not only to consider the residual stress removing methods but also to investigate the those of effects from the laboratory test. Laboratory scale welding specimen was made with both VSR and TSR method. The residual stress in the welding direction across the weld line was measured by using both the Barkhausen noise analysis method(BHN) and the hole drilling strain gage method(HDM). From the analyzed results, it was found that the TSR specimen showed lower residual stress than the as-welded specimen for all the butt, fillet and dissimilar butt joint. But, the VSR specimen did not show prominent stress reduction effect although there was some stress relieving.