Osteoporosis is a rising problem, as the older age population is increasing due to prolongation of life. Genetic and environmental factors play key roles in bone metabolism, and diet is also an important factor. We investigated the relationship among factors affecting bone mineral density (BMD), including daily food intake and nutrient intake in men aged >50 years. Seventy-eight men, who visited the health promotion center at one of the university medical centers, were divided into normal and osteopenia groups according to their BMD. The body weight of the normal group was significantly higher than that of the osteopenia group. The osteopenia group showed significantly higher carbohydrate intake and lower calcium and vegetable calcium intake compared to those in the normal group. Lumbar spine BMD was negatively correlated with energy, fat, vitamin B1, and sodium intake in the normal group. Additionally, femoral neck BMD was negatively correlated with total animal protein, energy, protein, fat, phosphorous, iron, animal iron, potassium, vitamin B1, B2, B6, and niacin intake. Lumbar spine BMD was positively correlated with fruit, calcium, vegetable calcium, animal calcium, and vitamin C intake in the osteopenia group. Femoral neck BMD was negatively correlated with meat, dairy product, total animal protein, plant protein, animal protein, vitamin A, and cholesterol intake. A stepwise multiple regression analysis revealed that several dietary factors affected BMD, including energy, fat, vitamin B1, B2, B6, niacin, sodium, protein, iron, animal iron, phosphorous, potassium, and animal protein in the normal group and zinc, calcium, vegetable calcium, animal calcium, vitamin C, fruit, protein, animal protein, meat, dairy product, carbohydrates, cholesterol, vegetables, mushrooms, and seasonings in the osteopenia group. These results indicate that adequate nutrient intake plays an important role maintaining optimum bone health in middle aged men.