Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare. 13(2):77–82, APR 2018

DOI: 10.1097/SIH.0000000000000267

,  

PMID: 29117092

Issn Print: 1559-2332

Publication Date: 2018/04/01


Share this on facebook   Share this on Twitter   Share this on LinkedIn   Email this article  



Print

The Development and Validation of a Concise Instrument for Formative Assessment of Team Leader Performance During Simulated Pediatric Resuscitations

Lindsay Nadkarni;Cindy Roskind;Marc Auerbach;Aaron Calhoun;Mark Adler;David Kessler;

+ Author Information


    loading  Checking for direct PDF access through Ovid

Abstract

AimThe aim of this study was to assess the validity of a formative feedback instrument for leaders of simulated resuscitations.MethodsThis is a prospective validation study with a fully crossed (person × scenario × rater) study design. The Concise Assessment of Leader Management (CALM) instrument was designed by pediatric emergency medicine and graduate medical education experts to be used off the shelf to evaluate and provide formative feedback to resuscitation leaders. Four experts reviewed 16 videos of in situ simulated pediatric resuscitations and scored resuscitation leader performance using the CALM instrument. The videos consisted of 4 pediatric emergency department resuscitation teams each performing in 4 pediatric resuscitation scenarios (cardiac arrest, respiratory arrest, seizure, and sepsis). We report on content and internal structure (reliability) validity of the CALM instrument.ResultsContent validity was supported by the instrument development process that involved professional experience, expert consensus, focused literature review, and pilot testing. Internal structure validity (reliability) was supported by the generalizability analysis. The main component that contributed to score variability was the person (33%), meaning that individual leaders performed differently. The rater component had almost zero (0%) contribution to variance, which implies that raters were in agreement and argues for high interrater reliability.ConclusionsThese results provide initial evidence to support the validity of the CALM instrument as a reliable assessment instrument that can facilitate formative feedback to leaders of pediatric simulated resuscitations.

Related Topics

        loading  Loading Related Articles