In robot system, the robot manipulation needs the information of task and objects to be handled in possessing a variaty of positions and orientations. In the current industrial robot system, determining position and orientation of objects under industrial environments is one of major problems. In order to pick up an object, the roblt needs the information about the position and orientation of object, and between objects and gripper. When sensing is accomplished by pinhole model camera, the mathematical relationship between object points and their images is expressed in terms of perspective, i.e., central projection. In this paper, a new approach to determine the information of the supporting points related to position and orientation of the object using the robot vision system is developed and testified in experimental setup. The result will be useful for the industrial, agricultural, and autonomous robot.