This paper presents a stochastic convergence analysis of LMS algorithm and VS-LMS algorithm for IIR filters using equation error formulation. Under the assumption that the signal is white Gaussian, theoretical equations that characterize the mean and mean-squared behaviors of the algorithms are derived. Computer simulation results show fairly good agreements between the theoretical and the empirical behaviors of the algorithms.