The seismic induced interaction between multistory structures with unequal story heights (inter-story pounding) is studied taking into account the local response of the exterior beam-column joints. Although several parameters that influence the structural pounding have been studied sofar, the role of the joints local inelastic behaviour has not been yet investigated in the literature as key parameter for the pounding problem. Moreover, the influence of the infill panels as an additional parameter for the local damage effect of the joints on the inter-story pounding phenomenon is examined. Thirty six interaction cases between a multistory frame structure and an adjacent shorter and stiffer structure are studied for two different seismic excitations. The results are focused: (a) on the local response of the critical external column of the multistory structure that suffers the hit from the slab of the adjacent shorter structure, and (b) on the local response of the exterior beam-column joints of the multistory structure. Results of this investigation demonstrate that the possible local inelastic response of the exterior joints may be in some cases beneficial for the seismic behaviour of the critical column that suffers the impact. However, in all the examined cases the developing demands for deformation of the exterior joints are substantially increased and severe damages can be observed due to the pounding effect. The presence of the masonry infill panels has also been proved as an important parameter for the response of the exterior beam-column joints and thus for the safety of the building. Nevertheless, in all the examined inter-story pounding cases the presence of the infills was not enough for the total amelioration of the excessive demands for shear and ductility of the column that suffers the impact.