This study proposes a human body orientation tracking system by inertial and earth magnetic sensors. These sensors were fused by indirect Kalman filter. The proposed tracking system was configured and the filter was implemented. The tracking performance was evaluated with static and dynamic tests. In static test, the sensor was fixed on the floor while its static characteristics was analyzed. In dynamic test, the sensor was held and moved manually for 30 seconds. The dynamic test included x, y, z axis rotations, and elbow flection/extension motions that mimic drinking. For these dynamic motions, the tracking angle error was under $4.1^{circ}$ on average. The proposed tracking method is expected to be useful for various human body motion analysis.