Geopolymer is a term covering a class of synthetic aluminosilicate materials with potential use in a number of areas, but mainly as a replacement for Portland cement. In this study, geopolymers with fly ash and meta kaolin were prepared using KOH as an alkali activator and water glass. The effect of water glass on the microstructures and the compressive strength of the geopolymer was investigated. As the amount of water glass increased, the dissolved inorganic binder particles in the geopolymers increased due to polymerization, resulting in a dense microstructure. The meta kaolin-based geopolymer showed a better extent of polymerization and densification than that of the fly ash-based geopolymer. XRD data also suggested that polymerization in meta kaolin-based geopolymers should be active resulting in the formation of an amorphous phase with an increasing amount of water glass. The compressive strength of the geopolymer was also dependent on the amount of water glass. The compressive strength of the geopolymers from both fly ash and meta kaolin increased with an increasing amount of water glass because water glass improved the extent of polymerization of the inorganic binder and resulted in a dense microstructure. However, the addition of water glass to the geopolymer did not seem to be effective for the improvement of compressive strength because the meta kaolin-based geopolymer mainly consisted of a clay component. For this reason, the fly ash-based geopolymer showed a higher value of compressive strength than the meta-kaolin geopolymer.