Bilinguals' ability to control which language they speak and to switch between languages may rely on neurocognitive mechanisms shared with non-linguistic task switching. However, recent studies also reveal some limitations on the extent control mechanisms are shared across domains, introducing the possibility that some control mechanisms are unique to language. We investigated this hypothesis by directly comparing the neural correlates of task switching and language switching. Nineteen Spanish–English bilingual university students underwent a functional magnetic resonance imaging (fMRI) study employing a hybrid (event-related and blocked) design involving both color-shape switching and language switching paradigms. We compared the two switching tasks using within-subject voxel-wise t-tests for each of three trial types (single trials in single blocks, and stay and switch trials in mixed blocks). Comparing trial types to baseline in each task revealed widespread activation for single, stay, and switch trials in both color-shape and language switching. Direct comparisons of each task for each trial type revealed few differences between tasks on single and switch trials, but large task differences during stay trials, with more widespread activation for the non-linguistic than for the language task. Our results confirm previous suggestions of shared mechanisms of switching across domains, but also reveal bilinguals have greater efficiency for sustaining the inhibition of the non-target language than the non-target task when two responses are available. This efficiency of language control might arise from bilinguals' need to control interference from the non-target language specifically when not switching languages, when speaking in single- or mixed-language contexts.