This paper describes the refined 3-D finite element (FE) modeling of composite frames composed of concrete-filled steel tubular (CFST) columns and steel-concrete composite beams based on the test to get a better understanding of the seismic behavior of the steel-concrete composite frames. A number of material nonlinearities and contact nonlinearities, as well as geometry nonlinearities, were taken into account. The elastoplastic behavior, as well as fracture and post-fracture behavior, of the FE models were in good agreement with those of the specimens. Besides, the beam and panel zone deformation of the analysis models fitted well with the corresponding deformation of the specimens. Parametric studies were conducted based on the refined finite elememt (FE) model. The analyzed parameters include slab width, slab thickness, shear connection degree and axial force ratio. The influences of these parameters, together with the presence of transverse beam, on the seismic behavior of the composite frame were studied. And some advices for the corresponding seismic design provisions of composite structures were proposed.