By showing the existence of the ARE solution and the convergence property of the DRE solution, this paper proves that a Kalman filter for the linear system with the unobservable bias is stable. It is also shown that the Kalman filter has a biased steady state estimation error whose covariance is affected mainly by the unobservable bias. Finally, the results are illustrated through a 2nd order system example including the inertial navigation system.