Simulation in healthcare : journal of the Society for Simulation in Healthcare
-
This study examined the reliability of the scores of an assessment instrument, the Debriefing Assessment for Simulation in Healthcare (DASH), in evaluating the quality of health care simulation debriefings. The secondary objective was to evaluate whether the instrument's scores demonstrate evidence of validity. ⋯ The DASH scores showed evidence of good reliability and preliminary evidence of validity. Additional work will be needed to assess the generalizability of the DASH based on the psychometrics of DASH data from other settings.
-
Review Meta Analysis
Comparative effectiveness of technology-enhanced simulation versus other instructional methods: a systematic review and meta-analysis.
To determine the comparative effectiveness of technology-enhanced simulation, we summarized the results of studies comparing technology-enhanced simulation training with nonsimulation instruction for health professions learners. We systematically searched databases including MEDLINE, Embase, and Scopus through May 2011 for relevant articles. Working in duplicate, we abstracted information on instructional design, outcomes, and study quality. ⋯ In random-effects meta-analysis, pooled effect sizes (positive numbers favoring simulation) were as follows: satisfaction outcomes, 0.59 (95% confidence interval, 0.36-0.81; n = 20 studies); knowledge, 0.30 (0.16-0.43; n = 42); time measure of skills, 0.33 (0.00-0.66; n = 14); process measure of skills, 0.38 (0.24-0.52; n = 51); product measure of skills, 0.66 (0.30-1.02; n = 11); time measure of behavior, 0.56 (-0.07 to 1.18; n = 7); process measure of behavior, 0.77 (-0.13 to 1.66; n = 11); and patient effects, 0.36 (-0.06 to 0.78; n = 9). For 5 studies reporting comparative costs, simulation was more expensive and more effective. In summary, in comparison with other instruction, technology-enhanced simulation is associated with small to moderate positive effects.
-
Randomized Controlled Trial
The effectiveness of video-assisted debriefing versus oral debriefing alone at improving neonatal resuscitation performance: a randomized trial.
Debriefing is a critical component of effective simulation-based medical education. The optimal format in which to conduct debriefing is unknown. The use of video review has been promoted as a means of enhancing debriefing, and video-assisted debriefing is widely used in simulation training. Few empirical studies have evaluated the impact of video-assisted debriefing, and the results of those studies have been mixed. The objective of this study was to compare the effectiveness of video-assisted debriefing to oral debriefing alone at improving performance in neonatal resuscitation. ⋯ Using this study design, we failed to show a significant educational benefit of video-assisted debriefing. Although our results suggest that the use of video-assisted debriefing may not offer significant advantage over oral debriefing alone, exactly why this is the case remains obscure. Further research is needed to define the optimal role of video review during simulation debriefing in neonatal resuscitation.
-
Defining valid, reliable, defensible, and generalizable standards for the evaluation of learner performance is a key issue in assessing both baseline competence and mastery in medical education. However, before setting these standards of performance, the reliability of the scores yielding from a grading tool must be assessed. Accordingly, the purpose of this study was to assess the reliability of scores generated from a set of grading checklists used by nonexpert raters during simulations of American Heart Association (AHA) Megacodes. ⋯ We have shown that our checklists can yield reliable scores, are appropriate for use by nonexpert raters, and are able to be used during continuous assessment of team leader performance during the review of a simulated Megacode. This checklist may be more appropriate for use by advanced cardiac life support instructors during Megacode assessments than the current tools provided by the AHA.