This study investigated factors that contribute to the clothing behavior and body image of elderly men, how these factors vary by demographic characteristics, and how these factors affect quality of life. The subjects were 250 elderly men selected by convenience sampling between the ages of 60 to 80 who lived in Gyeongnam province. They participated in a survey from May-June 2012. Out of the 250 participants only 227 were used to analyze the data due to the completeness of their survey. The results showed that the factors for clothing behavior were social psychological importance, conformity, economic efficiency, fashion interest, and interpersonal intention. For body image, the factors revealed were physical attractiveness, interest in appearance, and concern about weight. Differences in the clothing behavior, body image, and quality of life were indicated by the demographic characteristics of the subjects. Clothing behavior and body image of elderly men were revealed as a contributing factor towards quality of life.