• Tim Dwyer, Susan Glover Takahashi, Melissa Kennedy Hynes, Jodi Herold, David Wasserstein, Markku Nousiainen, Peter Ferguson, Veronica Wadey, M Lucas Murnaghan, Tim Leroux, John Semple, Brian Hodges, and Darrell Ogilvie-Harris.
• The Women's College Hospital, Mt. Sinai Hospital, Toronto, Ont.
• Can J Surg. 2014 Aug 1;57(4):230-6.

BackgroundAssessing residents' understanding and application of the 6 intrinsic CanMEDS roles (communicator, professional, manager, collaborator, health advocate, scholar) is challenging for postgraduate medical educators. We hypothesized that an objective structured clinical examination (OSCE) designed to assess multiple intrinsic CanMEDS roles would be sufficiently reliable and valid.MethodsThe OSCE comprised 6 10-minute stations, each testing 2 intrinsic roles using case-based scenarios (with or without the use of standardized patients). Residents were evaluated using 5-point scales and an overall performance rating at each station. Concurrent validity was sought by correlation with in-training evaluation reports (ITERs) from the last 12 months and an ordinal ranking created by program directors (PDs).ResultsTwenty-five residents from postgraduate years (PGY) 0, 3 and 5 participated. The interstation reliability for total test scores (percent) was 0.87, while reliability for each of the communicator, collaborator, manager and professional roles was greater than 0.8. Total test scores, individual station scores and individual CanMEDS role scores all showed a significant effect by PGY level. Analysis of the PD rankings of intrinsic roles demonstrated a high correlation with the OSCE role scores. A correlation was seen between ITER and OSCE for the communicator role, while the ITER medical expert and total scores highly correlated with the communicator, manager and professional OSCE scores.ConclusionAn OSCE designed to assess the intrinsic CanMEDS roles was sufficiently valid and reliable for regular use in an orthopedic residency program.

17 keywords...

hide…