Digital communication channels are imparied by linear effects such as dispersion, ISI(intersymbol Interference), fading phenomenon etc. But, the practical channel equalization system is required to design for compensating the nonlinear distortion caused by harmonic distortion etc. This paper is a study on the performance of nonlinear channel equalization using RBF(Radial Basis Funclion) network, which has the equivalent structure to the optimal Basian filter. Expecially, the variance of RBF network is modifiedby nonlinear polynomial filters to compare the convergence characteristic of nonlinear channel equalization. Experimental results show that the modified RBF network achieves the faster convergence property than conventional RBF network. Moreover, the RBF network ofhigher order variance modified represents the better performance than that of lower order variance in the bandpass channels and second/third order polynomial channels.