With flourishing of new facilities, we are now set to expand the horizon of the human knowledge of the universe deep into the very beginning of the cosmic history of astronomical objects. In such an endeavor, extreme objects and cosmic events such as violent cosmic explosions, rapidly growing supermassive black holes, and proto-clusters of galaxies, are the objects to be investigated in order to unveil what was happening in the very early universe. We will discuss what we have learned and are expecting to discover from such extreme objects about the infant universe both currently and in future, highlighting some of our recent works.