This paper addresses an adaptive postprocessing technique to remove blocking effects of the highly compressed images. The proposed technique removes blocking effects selectively by applying filters with different strength according to block analysis based on the directional activity. One-dimensional filters which are used to remove grid noises accomplish the adaptive filtering to the signal itself as well as to the directionality of the block. Moreover, we propose a detection method of the staircase noises and corner outliers and a two-dimensional directional filter to remove them. Experimental results for various images and bitrates show that the proposed method outperforms the conventional methods in PSNR for the objective performance and GBIM for the subjective quality evaluation.