In this paper we obtain the matrix Tau Method representation of a general boundary value problem for Fredholm and Volterra integro-differential equations of order $ u$. Some theoretical results are given that simplify the application of the Tau Method. The application of the Tau Method to the numerical solution of such problems is shown. Numerical results and details of the algorithm confirm the high accuracy and user-friendly structure of this numerical approach.