In the absence of a task, the human brain enters a mode of slow spontaneous fluctuations. A fundamental, unresolved question is whether these fluctuations are ongoing and thus persist during task engagement, or alternatively, are quenched and replaced by task-related activations. Here, we examined this issue in the human visual cortex, using fMRI. Participants were asked to either perform a recognition task of randomly appearing face and non-face targets (attended condition) or watch them passively (unattended condition). Importantly, in approximately half of the trials, all sensory stimuli were absent. Our results show that even in the absence of stimuli, spontaneous fluctuations were suppressed by attention. The effect occurred in early visual cortex as well as in fronto-parietal attention network regions. During unattended trials, the activity fluctuations were negatively linked to pupil diameter, arguing against attentional fluctuations as underlying the effect. The results demonstrate that spontaneous fluctuations do not remain unchanged with task performance, but are rather modulated according to behavioral and cognitive demands.