In this paper, we consider an extension to the continuous time risk model for which the occurrence of the claim may be delayed and the time of delay for the claim is assumed to be random. Two types of dependent claims, main claims and by-claims, are defined, where every by-claim is induced by the main claim. The time of occurrence of a by-claim is later than that of its associate main claim and the time of delay for the occurrence of a by-claim is random. An integro-differential equations system for the Gerber-Shiu discounted penalty function is established using the auxiliary risk models. Both the system of Laplace transforms of the Gerber-Shiu discounted penalty functions and the Gerber-Shiu discounted penalty functions with zero initial surplus are obtained. From Lagrange interpolating theorem, we prove that the Gerber-Shiu discounted penalty function satisfies a defective renewal equation. Exact representation for the solution of this equation is derived through an associated compound geometric distribution. Finally, examples are given with claim sizes that have exponential and a mixture of exponential distributions.