It is important for people to disengage attention from a distraction, which can help them complete the task at hand as quickly as possible. Recent studies have shown that people's attention stays longer on reward-distractors than on loss-distractors, and a delay in attentional disengagement is noted when reward-distractors are present. However, few studies have examined whether attentional disengagement from an evaluative distractor relies upon working memory (WM) components. In the present study, we used an attentional disengagement paradigm in which reward- or loss-distractors were presented at a central location and the target was presented at a peripheral location, in combination with different WM tasks. The results from Experiment 1 showed that participants were slower to disengage their attention from a central reward-distractor than a loss-distractor regardless of cognitive load when the phonological loop component of WM was involved. The results from Experiment 2 revealed that people had difficulty in shifting their attention away from a reward-distractor in comparison to a loss-distractor when spatial WM was low, whereas no such difference was observed when spatial WM was high. We conclude that WM components differently modulate attentional disengagement from evaluative distractors. That is, the processing of evaluative (reward and loss) distractors may rely on the same cognitive resources as the spatial WM component, but not the phonological loop component.