The present numerical study investigates flow characteristics and heat transfer enhancement of the viscoelastic non-Newtonian fluid in a 2:1 rectangular duct. The combined effect of temperature-dependent viscosity, buoyancy and secondary flow caused by second normal stress difference are all considered. The Reiner-Rivlin model is used as a viscoelastic fluid model to simulate the secondary flow and temperature-dependent viscosity model is adopted. Three types of thermal boundary conditions involving different combinations of heated walls and adiabatic walls are considered in this study. Calculated Nusselt numbers are in good agreement with experimental results in both the thermal developing and thermally developed regions. The heat transfer enhancement can be explained by the combined viscoelasticity-driven secondary flow, buoyancy-induced secondary flow and temperature-dependent viscosity.