• David Murray, John Boulet, Amitai Ziv, Julie Woodhouse, Joe Kras, and John McAllister.
• Department of Anaesthesiology, Washington University School of Medicine, Campus Box 8054, St. Louis, MO, USA.
• Med Educ. 2002 Sep 1; 36 (9): 833-41.

PurposeThis investigation aimed to explore the measurement properties of scores from a patient simulator exercise.MethodsAnalytic and holistic scores were obtained for groups of medical students and residents. Item analysis techniques were used to explore the nature of specific examinee actions. Interrater reliability was calculated. Scores were contrasted for third year medical students, fourth year medical students and emergency department residents.ResultsInterrater reliabilities for analytic and holistic scores were 0.92 and 0.81, respectively. Based on item analysis, proper timing and sequencing of actions discriminated between low- and high-ability examinees. In general, examinees with more advanced training obtained higher scores on the simulation exercise.ConclusionReliable and valid measures of clinical performance can be obtained from a trauma simulation provided that care is taken in the development and scoring of the scenario.

14 keywords...

hide…