A pair of point vortices of the same strength but opposite sign is called a vortex dipole. We consider the limiting case where two vortices approach infinitely close while the ratio of the strength to the distance kept constant. The motion of such point vortex dipole on the ellipsoid of revolution is investigated geometrically to conclude that the trajectory draws a geodesic up to the leading order of perturbation, whose direction is determined by the initial orientation of the dipole. Related issues are also remarked.