In this paper, first we propose an architecture of fuzzy neural networks with triangular fuzzy weights. The proposed fuzzy neural network can handle fuzzy input vectors. In both cases, outputs from the fuzzy network are fuzzy vectors. The input-output relation of each unit of the fuzzy neural network is defined by the extention principle of Zadeh. Also we define a cost function for the level sets(i. e., $alpha$-cuts)of fuzzy outputs and fuzzy targets. Then we derive a learning algorithm from the cost function for adjusting three parameters of each triangular fuzzy weight. Finally, we illustrate our a, pp.oach by computer simulation examples.