Mercury is a toxic and non-essential metal in the human body. Mercury is ubiquitously distributed in the environment, present in natural products, and exists extensively in items encountered in daily life. There are three forms of mercury, i.e., elemental (or metallic) mercury, inorganic mercury compounds, and organic mercury compounds. This review examines the toxicity of elemental mercury and inorganic mercury compounds. Inorganic mercury compounds are water soluble with a bioavailability of 7% to 15% after ingestion; they are also irritants and cause gastrointestinal symptoms. Upon entering the body, inorganic mercury compounds are accumulated mainly in the kidneys and produce kidney damage. In contrast, human exposure to elemental mercury is mainly by inhalation, followed by rapid absorption and distribution in all major organs. Elemental mercury from ingestion is poorly absorbed with a bioavailability of less than 0.01%. The primary target organs of elemental mercury are the brain and kidney. Elemental mercury is lipid soluble and can cross the blood-brain barrier, while inorganic mercury compounds are not lipid soluble, rendering them unable to cross the blood-brain barrier. Elemental mercury may also enter the brain from the nasal cavity through the olfactory pathway. The blood mercury is a useful biomarker after short-term and high-level exposure, whereas the urine mercury is the ideal biomarker for long-term exposure to both elemental and inorganic mercury, and also as a good indicator of body burden. This review discusses the common sources of mercury exposure, skin lightening products containing mercury and mercury release from dental amalgam filling, two issues that happen in daily life, bear significant public health importance, and yet undergo extensive debate on their safety.