Health care and academic systems are increasingly collaborating with community health advisors (CHAs) to provide culturally relevant health interventions that promote sustained community transformation. Little attention has been placed on CHA training evaluation, including core competency attainment. This study identified common CHA core competencies, generated a theoretically based measure of those competencies, and explored psychometric properties of that measure. A concept synthesis revealed five CHA core competencies (leadership, translation, guidance, advocacy, and caring). The CHA Core Competency Retrospective Pretest/Posttest (CCCRP) resulted from that synthesis, which was administered using multiple approaches to individuals who previously received CHA training (N = 142). Exploratory factor analyses revealed a two-factor structure underlying the posttraining data, and Cronbach's alpha indicated high internal consistency. This study suggested some CHA core competencies might be more interrelated than previously thought, and two major competencies exist rather than five and supported the CCCRP's use to evaluate core competency attainment resulting from training.