This study is aimed at formulating an empirical equation for the across-wind fluctuating moment and spectral density coefficient, which are needed to estimate the across-wind dynamic responses of tall buildings, as a function of the side ratios of buildings. In order to estimate an empirical formula, wind tunnel tests were conducted on aero-elastic models of the rectangular prisms with various aspect and side ratios in turbulent boundary layer flows. In this paper, criteria for the across-wind fluctuating moment and spectral density are briefly discussed and the results are analyzed mainly as a function of the side ratios of the buildings. Finally, empirical formulas for the across-wind fluctuating moment coefficient and spectral density coefficient according to variation of the aspect ratio are proposed.