Controversy revolves around the question of whether psychological factors like attention and emotion can influence the initial feedforward response in primary visual cortex (V1). Although traditionally, the electrophysiological correlate of this response in humans (the C1 component) has been found to be unaltered by psychological influences, a number of recent studies have described attentional and emotional modulations. Yet, research into psychological effects on the feedforward V1 response has neglected possible direct contributions of concomitant pupil-size modulations, which are known to also occur under various conditions of attentional load and emotional state. Here we tested the hypothesis that such pupil-size differences themselves directly affect the feedforward V1 response. We report data from two complementary experiments, in which we used procedures that modulate pupil size without differences in attentional load or emotion while simultaneously recording pupil-size and EEG data. Our results confirm that pupil size indeed directly influences the feedforward V1 response, showing an inverse relationship between pupil size and early V1 activity. While it is unclear in how far this effect represents a functionally-relevant adaptation, it identifies pupil-size differences as an important modulating factor of the feedforward response of V1 and could hence represent a confounding variable in research investigating the neural influence of psychological factors on early visual processing.