To overcome the limitations of the solid oxide fuel cells (SOFCs) due to the high temperature operation, there has been increasing interest in proton conducting fuel cells (PCFCs) for reduction of the operating temperature to the intermediate temperature range. In present work, the perovskite $BaCe_{0.85-x}Zr_xY_{0.15}O_{3-delta}$ (BCZY, x = 0.1, 0.3, 0.5, and 0.7) were synthesized via solid state reaction (SSR) and adopted as an electrolyte materials for PCFCs. Powder characteristics were examined using X-ray diffraction (XRD), thermogravimetric analysis (TGA) and Brunauer, Emmett and Teller (BET) surface area analysis. Single phase BCZY were obtained in all compositions, and chemical stability was improved with increasing Zr content. Anode-supported cell with $Ni-BaCe_{0.55}Z_{0.3}Y_{0.15}O_{3-delta}$ (BCZY3) anode, BCZY3 electrolyte and BCZY3-$Ba_{0.5}Sr_{0.5}Co_{0.8}Fe_{0.2}O_{3-delta}$ (BSCF) composite cathode was fabricated and electrochemically characterized. Open-circuit voltage (OCV) was 1.05 V, and peak power density of 370 ($mW/cm^2$) was achieved at $650^{circ}C$.