The magnetization properties have been measured for amorphous $Fe_{82}Mn_{8-x}B_xZr_{10}$ (x = 0-8) alloys. The temperature dependence of magnetization for these alloys shows the existence of antiferromagnetic couplings between Fe atoms in low fields at low temperatures. The magnetic parameters, obtained from the magnetization behavior are consistent with the presence of mixed magnetic state. The Curie temperature and magnetic moment increased with an increase of the concentration of B and spin glass like transition observed at low temperature decreases and finally vanishes at x = 8 at %. Our result suggests that the substitution of B for Mn seems to cause an increase of magnetic order.