A robust controller for large space structures(LSS) is studied from passivity point of view. While velocity sensors are commonly used for proportional-derivative (PD) control law to stabilize large space structures, if the structure can be controlled without velocity measurements, it is desirable against the failure of velocity sensors and for the cost reduction of the sensing system. In a recent result a dynamic output feedback control law has been provided using only displacement measurements. This paper presents a passivity-based controller design method and provides an alternative stability analysis tool for the previous displacement feedback robust control law. The closed-loop system can be viewed as a feedback interconnection of a passivated large space structure (LSS) and a strictly positive real (SPR) system.