On the controller switching time, even though on-line/off-line controller outputs are the same, a problem which deteriorates the performance of bumpless transfer can happen in case that any discrepancy between the two controller inputs is transferred directly to the controller output. In this paper, we analyze the cause of that phenomenon in existing research results and propose a new method which improves that problem. In order to solve this problem, the off-line controller is augmented to an anti-windup structure and an improved bumpless transfer method is derived by using the changed input of the off-line controller instead of the plant input. We exemplify the performance of the proposed method by comparing with the performance of the existing method via numerical examples.