We presented the holographic memory system using a multi-mode optical fiber. In this system, we multiplexed multiple holograms using the lights from multi-mode optical fibers as reference beams. The proposed system has two degrees of multiplexing freedom: speckle pattern of light coming from multi-mode fiber and spatial location of multi-mode fibers. Therefore, the data addressing in the system can be performed by mode and spatial multiplexings.