The influence regarding the dehydrogenation speed, at the desorption-recombination state during the hydrogenation-disproportionation-desorption-recombination (HDDR) process, on the microstructure and magnetic properties of Nd-Fe-B magnetic powders has been studied. Strip cast Nd-Fe-B-based alloys were subjected to the HDDR process after the homogenization heat treatment. During the desorption-recombination stage, both the pumping speed and time of hydrogen were systematically changed in order to control the speed of the desorption-recombination reaction. The magnetic properties of HDDR powders were improved as the pumping speed of hydrogen at the desorption-recombination stage was decreased. The lower pumping speed resulted in a smaller grain size and higher DoA. The coercivity and the remanence of the 200-300 ${mu}m$ sized HDDR powder increased from 12.7 to 14.6 kOe and from 8.9 to 10.0 kG, respectively. In addition, the remanence was further increased to 11.8 kG by milling the powders down to about 25-90 ${mu}m$, resulting in $(BH)_{max}$ of 28.8 MGOe.