This paper proposes a method to calculate magnetostrictive forces, displacement, and vibration modes of a large-scale Brushless DC(BLDC) motor by using a magneto-mechanically strong coupling formulation. The force is calculated using the energy method with magnetostrictive stress tensor. The mechanical vibration modes are also analyzed by using the principle of Hamilton and the calculated magneto-elastic forces acting on the surfaces of the stator. To verify the algorithm, 3 MW BLDC motor is simulated, and the forces, displacements, and vibration modes are calculated. The result shows that the mechanically stressed core has more deformation or displacements than those of the normal condition.