Randomized controlled trials (RCTs)—the gold standard for evaluating the effects of medical interventions—are notoriously challenging in terms of logistics, planning and costs. The cohort multiple randomized controlled trial approach is designed to facilitate randomized trials for pragmatic evaluation of (new) interventions and is a promising variation from conventional pragmatic RCTs. In this paper, we evaluate methodological challenges of conducting an RCT within a cohort. We argue that equally valid results can be obtained from trials conducted within cohorts as from pragmatic RCTs. However, whether this design is more efficient compared with conducting a pragmatic RCT depends on the amount and nature of non-compliance in the intervention arm.