A study on reliability estimation of sequential-ordered multiple failure modes, which are sequentially ordered between failure modes in a considering system, was performed. Especially, an approach to estimate the probabilities of failure modes has been proposed under an assumption that failure modes are mutually exclusive and sequentially ordered by only a critical variable. A feasibility of the proposed approach were studied by a practical example, which is a reliability estimation of passive safety systems for a probabilistic safety assessment(PSA) of a very high temperature reactor(VHTR) that is under development as a future nuclear system with enhanced safety features. It is difficult to define a robust failure state of this nuclear system because of its enhanced radiation release characteristics, so the new approach is a useful concept to estimate not only its safety but also a PSA. A feasibility study applied two failure modes(e.g., small and large release of radioactive materials) with considering the integrated behavior of this nuclear system. It is expected that the multiple release states for a practical estimation can be easily extended to the aforementioned example. It was found out that the proposed approach was a useful technique to cover the unfavorable features of this nuclear system as to performing a VHTR PSA.