In this paper, the formulation of the protection ratio based upon a composite fade margin and availability is newly presented for the detailed planning of frequency coordination in the microwave relay system network, and computed results for co-channel and adjacent channel protection ratios are illustrated over an actual system with 6.2 GHz. It is shown that the protection ratio to assure a quality of service can be expressed in terms of the composite fade margin, noise-to-interference ratio, net filter discrimination, and system parameters. In addition, the net filter discrimination, depending upon the transmitter spectrum mask and the overall receiver filter characteristic, has been examined to investigate the effect of the adjacent channel protection ratio caused by the adjacent channel interference. Regarding simulated results for 6.2 GHz, 60 km, 64-QAM, and N/I=6 dB at the bit error rate of $10^{-6}$, composite fade margin and co-channel protection ratio yield 25.14 and 50.3 dB, respectively. Also, the net filter discrimination of 26.5 dB and the adjacent channel protection ratio of 23.8 dB are obtained at the first adjacent channel of 30 MHz. The proposed method provides some merits in view of a comprehensive and practical application with more detailed and various system parameters needed to access the criteria for making the proper frequency coordination.