Executive control of attention is important for goal-directed behavior, and it is influenced by emotional information. This study examined the effect of stimulus valence on a color word flanker task and how individual differences within a general population may affect task performance. 119 participants completed a color word flanker task with task-irrelevant emotional information (positive, negative, neutral). This task was followed by several self-report scales that measured individual differences in attention control ability (ACS), current mood (PANAS), and emotion regulation ability (DERS). Faster reaction times and greater accuracy were associated with negative stimuli. The flanker effect was greater for negative trials than for neutral and positive trials. The greater flanker effect for negative trials was driven by decreased reaction time on negative congruent trials. A significant interaction was evident between stimulus valence and ACS score, such that reaction time was faster for negative trials than for neutral trials among those with low, average, and high ACS. However, this difference was largest for those with high ACS. Further, these relationships between attention control ability and executive control of attention were influenced by level of depressive symptoms (as measured by BDI-II). This study extends our knowledge about the relationship between executive control of attention to emotional stimuli and individual differences related to mood and attentional disorders in a general population. Study results may have important implications for theoretical models of cognitive control and task-irrelevant emotional information across individual differences.