Unlike rigid parts, flexible parts can be deformed by contact force during assembly. In robotic assembly, information about their deformation as well as possible misalignment between the holes and their respective mating parts is essential for successful assembly. This paper presents a method to design a visual sensing system for measuring parts deformation and misalignment in flexible parts assembly. This paper performs ray-trace analysis of the system. A series of experiments for flexible parts assembly by using the implemented system are performed.