Leukemia stem cells (LSCs) play important roles in leukemia initiation, progression and relapse, and thus represent a critical target for therapeutic intervention. Hence, it is extremely urgent to explore new therapeutic strategies directly targeting LSCs for acute myelogenous leukemia (AML) therapy. We show here that Angelica sinensis polysaccharide (ASP), a major active component in Dong quai (Chinese Angelica sinensis), effectively inhibited human AML $CD34^+CD38^-$ cell proliferation in vitro culture in a dose-dependent manner while sparing normal hematopoietic stem and progenitor cells at physiologically achievable concentrations. Furthermore, ASP exerted cytotoxic effects on AML K562 cells, especially LSC-enriched $CD34^+CD38^-$ cells. Colony formation assays further showed that ASP significantly suppressed the formation of colonies derived from AML $CD34^+CD38^-$ cells but not those from normal $CD34^+CD38^-$ cells. Examination of the underlying mechanisms revealed that ASP induced $CD34^+CD38^-$ cell senescence, which was strongly associated with a series of characteristic events, including up-regulation of p53, p16, p21, and Rb genes and changes of related cell cycle regulation proteins P16, P21, cyclin E and CDK4, telomere end attrition as well as repression of telomerase activity. On the basis of these findings, we propose that ASP represents a potentially important agent for leukemia stem cell-targeted therapy.