Electroencephalographic (EEG) reactivity testing is often presented as a clear-cut element of electrophysiological testing. Absence of EEG reactivity is generally considered an indicator of poor outcome, especially in patients after cardiac arrest. However, guidelines do not clearly describe how to test for reactivity and how to evaluate the results. In a quest for clear guidelines, we performed a systematic review aimed at identifying testing methods and definitions of EEG reactivity. We systematically searched the literature between 1970 and May 2016. Methodological quality of the studies was assessed using the QUality In Prognostic Studies tool. Quality of the descriptions of stimulus protocol and reactivity definition was rated on a four-category grading scale based on reproducibility. We found that protocols for EEG reactivity testing vary greatly and descriptions of protocols are almost never replicable. Furthermore, replicable definitions of presence or absence of EEG reactivity are never provided. In order to draw firm conclusions on EEG reactivity as a prognostic factor, future studies should include a precise stimulation protocol and reactivity definition to facilitate guideline formation.