Alignment failure sometimes occurs during the rubbing process because the rubbing cloth comes in direct contacts with the surface of the alignment film. A number of researches observed and evaluated the surface of the alignment film after the rubbing process had been reported. The real-time rubbing process has not been observed directly yet, though. In this study, the movement of the piles of the rubbing cloth during the rubbing process was observed with a high-speed camera. Furthermore, the relationship between the rubbing scratch on the alignment films and the movement of the pile was investigated. It was found that the movement of the pile affected the rubbing scratches.