Academic medicine : journal of the Association of American Medical Colleges
-
A faculty productivity profile system was designed to recognize faculty's contributions to administrative, educational, and research activities. It has long been recognized that clinical faculty receive little recognition or compensation for their efforts in education. Our surgery department previously had in place a recognition program for research achievements, but not for educational contributions. The new system was designed to recognize and reward all aspects of faculty contributions, including education. ⋯ Teaching medical students and residents is a rewarding experience; however, it requires significant time and effort. Faculty who feel their contributions are unrecognized may be more likely to burn out and less likely to continue contributing. We believe it is worthwhile to recognize faculty contributions in all areas, including education. Our pilot program had excellent participation due to the ease of using the form. We believe it has improved faculty morale and willingness to participate. We are continuing the program and plan to evaluate its impact on encouraging continued participation in teaching.
-
An essential principle of competency-based education (CBE) is use of observable outcomes with assessments as judgments of competence based on defined criteria. Faculty are accustomed to using learning objectives as the defining criteria for knowledge, assessing students using written exams. Faculty are less familiar with how the principles of CBE are applied to other competencies. We recently adopted school-wide goals and objectives, modeled after the ACGME Outcomes Project. The present objective was to give faculty first-hand experience in CBE within a basic science course, including both cognitive and non-cognitive outcomes. ⋯ Faculty achieved enhanced understanding of students, assisted by descriptive criteria, while suggesting improvements in forms. Better agreement on criteria definitions and consistency in form use is needed. Students developed understanding and improved communication/professionalism skills, based on repeated exposures to criteria and feedback. It remains to be seen whether the skills are used/developed in other courses. A majority of students did not use the learning portfolio as envisioned. Better design and implementation of school-wide rather than course-specific reflective portfolios may increase use and integrate learning in all courses with all six competencies.
-
The teaching OSCE (objective structured clinical examination) was developed from existing OSCE materials to provide direct observation and feedback to students on their doctor-patient relationship skills, students' abilities to do a focused history and physical examination, and to familiarize students with this type of examination. ⋯ Our department has used OSCEs for six years to evaluate students at the end of the third-year family medicine clerkship. Even after continuous improvement, our OSCE did not meet higher standards of reliability and would need at least three hours of testing per student to meet those standards. The low number of students in the rotation and limited resources to increase the duration of the OSCE made it very difficult to construct a more reliable examination. At the same time, both faculty and students wanted more direct observation and feedback on performance with clinical scenarios. Using existing OSCE resources to change the OSCE to a teaching tool proved to be an efficient use of teaching resources while increasing our educational impact. Students report that they appreciate the opportunity to have constructive discussions of their strengths and weaknesses in clinical encounters, observe a variety of doctor-patient interaction styles, and practice for future OSCE-type examinations. Faculty members enjoy this active teaching format and find the process of students giving feedback to their peers educationally useful. The teaching OSCE has been extremely well rated in the end-of-rotation evaluations and will be continued in future clerkships.
-
Computer-based testing (CBT) for the purpose of the national licensure examination has increased interest among medical students in this modality of testing. The advent of Web-based question-delivery systems for self-assessment and learning has made it possible for students to practice this technology and participate in self-directed learning. Test Pilot(TM) is a Web-based program that provides a fast and easy tool for the development and deployment of online testing. Our objectives for introducing the program were to (1) develop a large database of questions for students' practice and self-assessment; (2) include multimedia tools such as illustrations and short videos to enhance learning; (3) provide a feedback tool for clerkship and site directors regarding student performance; and (4) evaluate this tool in terms of students' frequency of use, students' satisfaction, and its potential effectiveness in enhancing learning. ⋯ Test Pilot has many benefits, including access control, immediate feedback, automated scoring, interactive learning, and data analysis. The enhancement of material permitted by a Web-based system increases the depth and variety of the learning experience by adding perceptual dimensions. Test Pilot also provides the clerkship director with the capability to obtain improved measurements of student performance and captures the student's self-learning and testing process. It can potentially identify weaknesses or inconsistencies across the different sites and recognize students who may need additional help early in the rotation. Over a one-year period, most students have switched from the quiz disks to Test Pilot. The students reported satisfaction with the Web-based format and found it user friendly. They especially liked the immediate feedback. The students have requested more questions and multimedia options be added. We plan to continue the development and assessment of this learning tool.
-
Continuing medical education (CME) has not taken advantage of the ability to communicate and collaborate online. Collaborative learning is an important learning principle, yet online CME programs are generally completed in a one-on-one relationship between the computer and the learner. This limits opportunities for reflective learning, and does not access the rich learning available from interacting with peers. We believe online CME will benefit from interaction between learners and from opportunities for reflection. ⋯ We are in the last week of the class and the participant feedback has been overwhelmingly positive. Many note how well the course design and timing match their learning styles and schedule constraints. A powerful feature has been our ability to identify additional educational needs, and quickly add corresponding content online. So far, participants have provided 340 postings, which include evidence of course effectiveness and documentation of application of course objectives and disease management strategies to change actual practice patterns. GPs report changing: screening practices for diabetic renal disease; prescribing of diabetic medications; screening protocols for diabetes; and organizing practice management systems to better track diabetic care. After diagnosing and managing a new diabetic patient during the course, one participant wrote: "It was fantastic to feel that I am offering an up-to-date evidence-based approach in something that I am deskilled in." This course is unique in online CME. It is international in scope, collaborative, asynchronous in delivery, flexible, responsive to learner needs in real time, and has yielded evidence of its effectiveness in changing the actual clinical practices of participants. It will next enroll GPs in Singapore and additional UK-based GPs. Additional CME courses will be developed using this method.