A panoramic video which supports to make viewers feel an immersion through fitting to a wide field of view (FOV) larger than the human visual angle needs an interactive viewing method such as selecting targeted view point among widely viewing points of a panoramic video because it difficult to simultaneously view a whole panoramic video due to a limited viewing environment and bandwidth. When a user officially uses a view navigation in order to select a view point, it happens waste of resources such as bandwidth owing to the transmitted video data of unnecessary view points. Therefore, this paper proposes the spatial-temporal prediction filter (STPF) which is based on the direction and velocity of the view navigation for transmitting only the necessary video data. As a result of simulation, STPF reduces bitrate saving rates by from 6% to 37% compared to conventional methods in the interactive panoramic video streaming service required high bandwidth.