The ubiquitous environment is to support people in their everyday life in an inconspicuous and unobtrusive way. This environment requires information such as the person, his/her preferences, and habits which is available in the ubiquitous system. In this paper, we propose the context aware system that can provide the tailored information service for user in ubiquitous computing environment. Our system architecture is divided into 4 domain models such as context awareness, presentation, interface and inference domain. Each domain model can perform some predefined tasks independently. And we suggest the hybrid algorithm combined with fuzzy and Bayesian method in order to reason what is the suitable information for user. We show the possibility for the real application through applying the system to the TGA (Tour Guide Assistant) for Kyoungju historical site.