In performing the dynamic analysis, the step size used in a step-by-step integration method might be much smaller than that required by the accuracy consideration in order to capture the rapid chances of dynamic loading or to eliminate the linearization errors. It was first found by Chen and Robinson that these difficulties might be overcome by integrating the equations of motion with respect to time once. A further study of this technique is conducted herein. This include the theoretical evaluation and comparison of the capability to capture the rapid changes of dynamic loading if using the constant average acceleration method and its integral form and the exploration of the superiority of the time integration to reduce the linearization error. In addition, its advantage in the solution of the impact problems or the wave propagation problems is also numerically demonstrated. It seems that this time integration technique can be applicable to all the currently available direct integration methods.