Disruptions in early life care, including neglect, extreme poverty, and trauma, influence neural development and increase the risk for and severity of pathology. Significant sex disparities have been identified for affective pathology, with females having an increased risk of developing anxiety and depressive disorder. However, the effects of early life stress (ELS) on cognitive development have not been as well characterized, especially in reference to sex specific impacts of ELS on cognitive abilities over development. In mice, fragmented maternal care resulting from maternal bedding restriction, was used to induce ELS. The development of spatial abilities were tracked using a novel object placement (NOP) task at several different ages across early development (P21, P28, P38, P50, and P75). Male mice exposed to ELS showed significant impairments in the NOP task compared with control reared mice at all ages tested. In female mice, ELS led to impaired NOP performance immediately following weaning (P21) and during peri-adolescence (P38), but these effects did not persist into early adulthood. Prior work has implicated impaired hippocampus neurogenesis as a possible mediator of negative outcomes in ELS males. In the hippocampus of behaviorally naïve animals there was a significant decrease in expression of Ki-67 (proliferative marker) and doublecortin (DCX-immature cell marker) as mice aged, and a more rapid developmental decline in these markers in ELS reared mice. However, the effect of ELS dissipated by P28 and no main effect of sex were observed. Together these results indicate that ELS impacts the development of spatial abilities in both male and female mice and that these effects are more profound and lasting in males.