Based on N-body simulations, we find out that significant fraction of dynamically formed BH-BH (10 $M_{odot}$ and NS-NS (1.4 $M_{odot$ ecah) binaries are ejected from globular clusters. About 30 percent of compact stars are ejected in the form of binary. The merging time of ejected binary depends on the velocity dispersion of globular cluster. Some of ejected binaries have merging time-scales shorter than Hubble time and are expected to produce gravitational waves that can be detectable by the advanced ground-based interferometers. The merger rates of ejected BH-BH and NS-NS binaries per globular cluster are estimated to be 3.5 and 17 per Gyr, respectively. Assuming the spatial density of globular clusters as 8.4 $h^3$ clusters $Mpc^{-3}$ and extrapolating to the horizon distance of the advanced LIGO-Virgo network, we expect the detection rates solely attributed to BH-BH and NS-NS with cluster origin are to be 42 and 1.7 $yr^{-1}$, respectively. Besides, we find out that BH-NS binary ejection hardly occurs in globular clusters and dynamically formed compact binaries may possibly be the source of short GRBs whose locations are far from host galaxies.