To investigate the effects of residual displacement, the structural responses of buckling-restrained braced frames (BRBF) and special moment-resisting frames (SMRF) were evaluated for design-based excitations following an application of initial residual drift. The initial residual drift was applied to the structure in two ways. The first way was to simply apply the same earthquake record to the structure twice, with an appropriate pause between applications to allow the structural response from the first record to return to zero. The second way to apply the initial residual drift was to apply a pushover to the structure until it arrives at the desired residual drift value. According to the analysis results, the initial residual drifts had a significant effect on the responses of steel BRBF and SMRF. The responses of BRBF were more highly dependent on the initial residual deformation than the responses of SMRF. Therefore, in order to minimize the post-event repair cost, a reduction of residual drift is required.