While many studies have reported working memory (WM) impairments in autism spectrum disorders, others do not. Sample characteristics, WM domain, and task complexity likely contribute to these discrepancies. Although deficits in visuospatial WM have been more consistently documented, there is much controversy regarding verbal WM in autism. The goal of the current study was to explore visuospatial and verbal WM in a well-controlled sample of children with high-functioning autism (HFA) and typical development. Individuals ages 9–17 with HFA (n = 18) and typical development (n = 18), were carefully matched on gender, age, IQ, and language, and were administered a series of standardized visuospatial and verbal WM tasks. The HFA group displayed significant impairment across WM domains. No differences in performance were noted across WM tasks for either the HFA or typically developing groups. Over and above nonverbal cognition, WM abilities accounted for significant variance in language skills and symptom severity. The current study suggests broad WM limitations in HFA. We further suggest that deficits in verbal WM are observed in more complex tasks, as well as in simpler tasks, such as phonological WM. Increased task complexity and linguistic demands may influence WM abilities.