We propose an improvement of particle swarm optimization (PSO) based on the stabilization of particle movement (PM). PSO uses a stochastic variable to avoid an unfortunate state in which every particle quickly settles into a unanimous, unchanging direction, which leads to overshoot around the optimum position, resulting in a slow convergence. This study shows that randomly located particles may converge at a fast speed and lower overshoot by using the proportional-integral-derivative approach, which is a widely used feedback control mechanism. A benchmark consisting of representative training datasets in the domains of function approximations and pattern recognitions is used to evaluate the performance of the proposed PSO. The final outcome confirms the improved performance of the PSO through facilitating the stabilization of PM.