We describe the Infrared Medium-deep Survey (IMS), a survey of quasars in the early universe beyond z=5. IMS uses multi-wavelength archival data such as SDSS, CFHT-LS, UKIDSS, and SWIRE, which provide deep images over wide area enough for searching of high redshift bright quasars. In addition, we are carrying out J-band imaging survey with the depth of 23AB at UKIRT for up to 200 $deg^2$, of which 50 $deg^2$ is covered so far. For the quasar candidates at z~5.5, we are making observations with custom-made filters, which are more efficient to make robust quasar candidate samples in this redshift range. Because of the deeper survey depth and the unique methods, our IMS can provide a large number of high redshift quasars comparing with ongoing high redshift bright quasar survey. The high redshift quasars we confirm will give us with clues of the growth of super massive black holes and the metal enrichment history in the early universe.