Historically, architecture was part of mathematics and architects were mathematicians. In this paper, we attempted to analyze the architecture from the mathematical point of view and conclude that pursuit of beauty and balance lead to the mathematically rigorous shape. For example, the golden ratio in the Great Pyramid and Parthenon prevail in the modem arts and architecture. We also conclude that mathematics is not invention but discovery at least in the area of architecture.