Because of the burgeoning demand of the energy, the countries are finding sustainable solutions for these emerging challenges. Demand Side Management is playing a significant role in managing the demand with an aim to support the electrical grid during the peak hours. However, advancement in controls and communication technologies, the aggregators are appearing as a third party entity in implementing demand response program. In this paper, a detailed mathematical framework is discussed in which the aggregator acts as an energy service provider between the utility and the consumers, and facilitate the consumers to actively participate in demand side management by introducing the new concept of demand reduction bidding (DRB) under constrained direct load control. Paper also presented an algorithm for the proposed framework and demonstrated the efficacy of the algorithm by considering few case studies and concluded with simulation results and discussions.