• Rushad Patell, Paola Raska, Natalie Lee, Gina Luciano, Deborah J DiNardo, Amiran Baduashvili, Mel L Anderson, Frank Merritt, and Michael B Rothberg.
• Department of Hematology-Oncology, Beth Israel Deaconess Medical Center, Boston, MA, USA.
• J Gen Intern Med. 2020 May 1; 35 (5): 1530-1536.

BackgroundMedical educators need valid, reliable, and efficient tools to assess evidence-based medicine (EBM) knowledge and skills. Available EBM assessment tools either do not assess skills or are laborious to grade.ObjectiveTo validate a multiple-choice-based EBM test-the Resident EBM Skills Evaluation Tool (RESET).DesignCross-sectional study.ParticipantsA total of 304 medicine residents from five training programs and 33 EBM experts comprised the validation cohort.Main MeasuresInternal reliability, item difficulty, and item discrimination were assessed. Construct validity was assessed by comparing mean total scores of trainees to experts. Experts were also asked to rate importance of each test item to assess content validity.Key ResultsExperts had higher total scores than trainees (35.6 vs. 29.4, P < 0.001) and also scored significantly higher than residents on 11/18 items. Cronbach's alpha was 0.6 (acceptable), and no items had a low item-total correlation. Item difficulty ranged from 7 to 86%. All items were deemed "important" by > 50% of experts.ConclusionsThe proposed EBM assessment tool is a reliable and valid instrument to assess competence in EBM. It is easy to administer and grade and could be used to guide and assess interventions in EBM education.

9 keywords...

hide…