• Jason Fleming, Karan Kapoor, Nick Sevdalis, and Meredydd Harries.
• ENT Department, Royal Sussex County Hospital, Brighton, United Kingdom. jcfleming@doctors.net.uk
• Laryngoscope. 2012 May 1; 122 (5): 1099-103.

Objectives/HypothesisTo assess the face and construct validity of two assessment tools for a microlaryngoscopy simulator-a Checklist Assessment for Microlaryngeal Surgery and Global Rating Assessment for Microlaryngeal Surgery.Study DesignBlinded experimental simulator-based study.MethodsThere were 15 candidates divided into a novice (≤50 procedures performed) or experienced (>50 procedures) group depending on their previous microlaryngoscopy experience. Each candidate undertook a 10-minute simulation of a microlaryngoscopy and excision biopsy, and two blinded experts rated their performance live on each of the two assessment tools. To assess face validity, each candidate subsequently completed a questionnaire about the simulator.ResultsThe model demonstrated good face validity across all levels of experience. The global rating assessment demonstrated excellent interrater reliability (0.9) compared to the checklist assessment (0.7). The checklist assessment was able to differentiate experienced and novice candidates and therefore demonstrated construct validity. The global rating tool, however, was unable to differentiate candidates. There was a significant correlation between the two assessment tools (correlation coefficient = 0.624).ConclusionsThis study is the first reported study of a high-fidelity microlaryngoscopy simulator with task-specific rating tools. Use of these tools is recommended within otolaryngology training programs, with the global rating assessment for use as a frequently used feedback tool, and the checklist assessment as a confirmatory evaluation of competency at transitions of professional training.Copyright © 2012 The American Laryngological, Rhinological, and Otological Society, Inc.

13 keywords...

hide…