• Andrew R Pulito, Michael B Donnelly, and Margaret Plymale.
• Department of Surgery, College of Medicine, University of Kentucky, Lexington, Kentucky, USA. arpuli@uky.edu
• Med Educ. 2007 Jul 1; 41 (7): 667-75.

ContextFaculty members often use global rating scales as a method of assessing various characteristics of medical students' clinical performance. The purpose of this study was to determine if some performance characteristics are more highly associated with the overall faculty grade than others.MethodsThe clinical performance of 211 surgery clerkship students was evaluated by 2 or 3 faculty preceptors. Faculty rated students on 10 specific performance characteristics, using a 5-point scale. Faculty then assigned a numerical grade summarising the faculty's view of the student's performance. Reliability of the ratings was estimated by the intraclass correlation, and 1-way (analysis of variance) anova was used to test for differences among the students' mean ratings. Logistic regression was employed to determine the accuracy of each performance measure in predicting students' grades (A or B). Stepwise logistic regression was used to determine if there was a combination of performance characteristics that best predicted students' grades.ResultsThe inter-rater reliabilities were low (ConclusionsThe rating on any single characteristic predicts a student's overall grade very accurately. Additional measures do not greatly increase the accuracy of prediction. Our results suggest that faculty make a relatively undifferentiated judgement in assigning student grades, and there is little to be gained by using multi-item forms in assessing medical students' clinical performance.

17 keywords...

hide…