Cues that signal rewards can motivate reward-seeking behaviors, even for outcomes that are not currently desired. Three experiments examined this phenomenon, using an outcome-selective Pavlovian-instrumental transfer (PIT) design and an outcome devaluation procedure. In Experiment 1, participants learned to perform one response to earn crisps points and another response to earn popcorn points. One outcome was then devalued by adulterating it to make it taste unpleasant. On test, overall response choice was biased toward the outcome that had not been devalued, indicating goal-directed control. Stimuli that signaled crisps and popcorn also biased instrumental response choice toward their respective outcomes (a PIT effect). Most importantly, the strength of this bias was not influenced by the devaluation manipulation. In contrast, Experiment 2 demonstrated that when stimuli signaled equal probability of the two outcomes, cue-elicited response choice was sensitive to the devaluation manipulation. Experiment 3 confirmed this conclusion by demonstrating a selective avoidance of the cued, devalued outcome. Together, these data support a goal-directed model of PIT in which expected outcome probability and value make independent contributions to response choice.