Qualified ground control points (GCPs) are required to construct a digital elevation model (DEM) from a pushbroom stereo pair. An inverse geolocation algorithm for extracting GCPs from ERS SAR data and the SRTM DEM was recently developed. However, not all GCPs established by this method are accurate enough for direct application to the geometric correction of pushbroom images such as SPOT, IRS, etc, and thus a method for selecting and removing inaccurate points from the sets of GCPs is needed. In this study, we propose a method for evaluating GCP accuracy and winnowing sets of GCPs through orientation modeling of pushbroom image and validate performance of this method using SPOT stereo pair of Daejon City. It has been found that the statistical distribution of GCP positional errors is approximately Gaussian without bias, and that the residual errors estimated by orientation modeling have a linear relationship with the positional errors. Inaccurate GCPs have large positional errors and can be iteratively eliminated by thresholding the residual errors. Forty-one GCPs were initially extracted for the test, with mean the positional error values of 25.6m, 2.5m and -6.1m in the X-, Y- and Z-directions, respectively, and standard deviations of 62.4m, 37.6m and 15.0m. Twenty-one GCPs were eliminated by the proposed method, resulting in the standard deviations of the positional errors of the 20 final GCPs being reduced to 13.9m, 8.5m and 7.5m in the X-, Y- and Z-directions, respectively. Orientation modeling of the SPOT stereo pair was performed using the 20 GCPs, and the model was checked against 15 map-based points. The root mean square errors (RMSEs) of the model were 10.4m, 7.1m and 12.1m in X-, Y- and Z-directions, respectively. A SPOT DEM with a 20m ground resolution was successfully constructed using a automatic matching procedure.