$Mn^{4+}$-doped $CaAl_4O_7$ ($CA_2$) and $CaAl_{12}O_{19}$ ($CA_6$) powders were prepared under different conditions, with changes in the amounts of flux, Mn concentration, and mole ratio of $Al_2O_3$ to $CaCO_3$ in the starting mixtures, which affected the structure and the luminescence. $CA_2:Mn^{4+}$ and $CA_6:Mn^{4+}$ had the same excitation and emission spectra but with different intensities. The excitation spectra exhibited broad bands (320 - 470 nm) centered at 395 nm, while red emission bands were observed at 656 nm. The emission intensity of $CA_6:Mn^{4+}$ was nearly twice as high as that of $CA_2:Mn^{4+}$, as the $Mn^{4+}$ ions were located in an octahedral crystal field in the $CA_6$, but not in the $CA_2$.