Tissue stem cells often exhibit developmental stage-specific and sexually dimorphic properties, but the underlying mechanism remains largely elusive. By characterizing IGF1R signaling in hematopoietic cells, here we report that its disruption exerts sex-specific effects in adult hematopoietic stem and progenitor cells (HSPCs). Loss of IGF1R decreases the HSPC population in females but not in males, in part due to a reduction in HSPC proliferation induced by estrogen. In addition, the adult female microenvironment enhances engraftment of wild-type but not Igf1r -null HSPCs. In contrast, during gestation, when both female and male fetuses are exposed to placental estrogens, loss of IGF1R reduces the numbers of their fetal liver HSPCs regardless of sex. Collectively, these data support the interplay of IGF1R and estrogen pathways in HSPCs and suggest that the proliferation-promoting effect of estrogen on HSPCs is in part mediated via IGF1R signaling.