The Authors Respond
In complex and multifaceted field studies, defining compliance is rarely straightforward, and we admit to a “pragmatic compliance definition.” Instead of using our equal-weight analysis, we would have preferred a definition that weighed the WASH components based on each of their individual contributions to health, where the parameters were informed by meta-analyses or the broader literature, and where interdependencies were considered between different WASH components (e.g., handwashing requires water).3,4 Due to a paucity of school-WASH studies in the literature, we found little empirical support to inform such complex weighting. While more complex weighting might have been better for our particular analysis, the ideal IV analysis would require a study with multiple WASH intervention arms, and then multiple instrumental variables could be employed to assess the impacts due to varying WASH combinations.
There is indeed a need for further development of compliance definitions for interventions that are multifaceted, time varying, and/or implemented at the cluster level. Compliance to these types of interventions is more likely to be measured across a continuous spectrum, so compliance definitions will need to move both methodologically and linguistically beyond binary categorizations (e.g., complier vs. not). The structural nested model framework is robust and should allow for these more complex adherence definitions, but also has a different interpretation than other IV frameworks, such as the principal stratification framework. The effects we produced using structural nested models are actually different than the complier average causal effect. The complier average causal effect conditions on being a “complier,” a latent principal stratum that is unobserved, and is defined as a person who would always comply with their assigned treatment regardless of the treatment assignment. The effect from a structural nested model is conditional on observed adherence, where the adherers (e.g., A = 1) might also include people (or schools in our case), who were assigned to the control group but were observed to be adhering (e.g., “always-takers”). While structural nested models may allow for robust adherence definitions, traditionally used terms such as “adherence” and “compliance” must also be relaxed linguistically to allow for incremental adherence levels and also for “adherence” by individuals who might have already been “adhering” to the interventions before the study ever started.