Modal testing requires measuring the vibration of many points, for which an accelerometer, a gab sensor and laser vibrometer are generally used. Conventional modal testing requires mounting of these sensors to all measurement points in order to acquire the signals. However, this can be disadvantageous because it requires considerable measurement time and effort when there are many measurement points. In this paper, we propose a method for modal testing using a camera image. A camera can measure the vibration of many points at the same time. However, this task requires that the measurement points be classified frame by frame. While it is possible to classify the measurement points one by one, this also requires much time. Therefore, we try to classify multiple points using pattern recognition. The feasibility of the proposed method is verified by a beam experiment. The experimental results demonstrate that we can obtain good results.