In this paper, an oscillator using dielectric-rod loaded cavity resonators with HTS(High Temperature Superconductor) end-plates was presented. It was operated at X-band. A two port cavity resonator was incorporated into a basic feedback loop oscillator configuration. A rutile loaded cavity resonator with HTS thin film end-plates was used to provide the quality factor between $10^4$ and $10^6$. A parallel feedback oscillator was constructed with a dielectric loaded cavity resonator, an amplifier, and a directional coupler. At 300 K, the experimental results showed the phase noise of -108 dBc/Hz at a 100 kHz offset frequency. At 26 K, the results was -118.8 dBc/Hz at same offset frequency.