• Wan-Hua Yang, Yun-Hsiang Chan, Cheng-Pin Huang, and Tzeng-Ji Chen.
• Department of Pathology and Laboratory, Taipei Veterans General Hospital Hsinchu Branch, Hsinchu, Taiwan, ROC.
• J Chin Med Assoc. 2024 May 1; 87 (5): 525530525-530.

BackgroundThis study examines the comparative effectiveness of GPT-3.5 and GPT-4.0, in the certification of medical technologists (MT) in Taiwan, exploring their adeptness in processing complex medical language and their contributory role in the educational and communicative aspects of professional healthcare training.MethodsThis study used GPT-3.5 and GPT-4.0 to test the medical laboratory technician professional college entrance examination questions. The questions in different fields, including six subjects, such as Clinical Physiology and Pathology, Hematology, and Blood Bank, among others were answered one-on-one using two generative pretrained transformer (GPT) versions, simulating the situations during exam preparation.ResultsA total of 480 questions were analyzed and the results showed that both versions of the GPT met the certification standards. Version 4.0 was better than version 3.5 for all subjects, particularly in Clinical Biochemistry (score = 96.25) and Microbiology (score = 91.25). Outstanding performance compared to version 3.5, which had an average score of 65.42 and a maximum score of 77.5. Overall, version 4.0, which was significantly better than version 3.5 in both median and average scores, reflects a significant improvement in professional knowledge processing capabilities.ConclusionThe GPT can provide valuable support for both the upstream and downstream processes of MT certification. Future research can further explore the application of GPT in different educational and certification contexts and improve the passing rate of medical personnel in the certification process. This study provides useful information for exploring the potential applications of GPT in certifying medical examiners. Furthermore, it provides new directions for future research in medical education.Copyright © 2024, the Chinese Medical Association.

17 keywords...

hide…