In this paper, we propose a stress assessment method of indoor noise in a TV-watching environment, which is based on a subjective listening test using TV contents and indoor noises. To this end, mental and hearing health assessments are first conducted on participants to evaluate whether they are suitable for performing the listening test. Next, the participants who are eligible to the test are requested to give a subjective stress score for each indoor noise that is played while watching TV contents. In this case, each noise is manipulated according to its type and loudness. Simultaneously, a database (DB) of the TV contents and the indoor noises for stress assessment is collected by binaural recording though a dummy head located on a televiewer’s position in a real-life TV watching environment. In order to demonstrate the usefulness of the proposed stress assessment method, we constructed a sound DB that was composed of 10 hours of five different TV audio contents and 2 hours of 28 different types of indoor noise. After that, we performed MMPI2-RF based mental health assessments, pure-tone audiometry, and a listening test based stress assessment for 10 participants, which resulted in the statistics of stress score for 2 hours.