In this paper, we consider a decentralized observer design problem for fault detection in large-scaled linear time-invariant systems. Since the fault detection residual is desired to be sensitive on the fault, we use the H_ index performance criterion. Sufficient conditions for the existence of such an observer is presented in terms of linear matrix inequalities. Simulation results show the effectiveness of the proposed method.