• J Eval Clin Pract · Feb 2025

    Development and Content Analysis Protocol for Evaluating Artificial Intelligence in Drug-Related Information.

    • Dantony Castro Barros de Donato, Guilherme José Aguilar, Lucas Gaspar Ribeiro, Luiz Ricardo Albano Dos Santos, Luana Michelly Aparecida Costa Dos Santos, Wilbert Dener Lemos Costa, and Alan Maicon de Oliveira.
    • Ribeirão Preto Medical School, University of São Paulo, Ribeirão Preto, São Paulo, Brazil.
    • J Eval Clin Pract. 2025 Feb 1; 31 (1): e14276e14276.

    IntroductionArtificial intelligence (AI) has significant transformative potential across various sectors, particularly in health care. This study aims to develop a protocol for the content analysis of a method designed to assess AI applications in drug-related information, specifically focusing on contraindications, adverse reactions, and drug interactions. By addressing existing challenges, this preliminary research seeks to enhance the safe and reliable integration of AI into healthcare practices.MethodsA study protocol was developed for the creation of the method, followed by an initial content analysis conducted by an expert panel. The method was established in phases: (1) Analysis of drug-related databases and form development; (2) AI configuration; (3) Expert panel review and initial validation.ResultsIn Phase 1, the Micromedex, UpToDate, and Medscape databases were reviewed to establish terminology and classifications related to contraindications, adverse reactions, and drug interactions, resulting in the development of a questionnaire for the AI. Phase 2 involved configuring the Gemini AI tool to enhance response specificity. In Phase 3, AI responses to 30 questions were validated by an expert panel, yielding a 76.7% agreement rate for appropriateness, while 23.3% were deemed inappropriate, particularly concerning contraindicated drug interactions.ConclusionThis preliminary study demonstrates the potential for using an AI-powered tool to standardize drug-related information retrieval, particularly for contraindications and adverse reactions. While AI responses were generally appropriate, improvements are needed in identifying contraindicated drug interactions. Further research with larger datasets and broader evaluations is required to enhance AI's reliability in healthcare settings.© 2024 John Wiley & Sons Ltd.

      Pubmed     Copy Citation     Plaintext  

      Add institutional full text...

    Notes

     
    Knowledge, pearl, summary or comment to share?
    300 characters remaining
    help        
    You can also include formatting, links, images and footnotes in your notes
    • Simple formatting can be added to notes, such as *italics*, _underline_ or **bold**.
    • Superscript can be denoted by <sup>text</sup> and subscript <sub>text</sub>.
    • Numbered or bulleted lists can be created using either numbered lines 1. 2. 3., hyphens - or asterisks *.
    • Links can be included with: [my link to pubmed](http://pubmed.com)
    • Images can be included with: ![alt text](https://bestmedicaljournal.com/study_graph.jpg "Image Title Text")
    • For footnotes use [^1](This is a footnote.) inline.
    • Or use an inline reference [^1] to refer to a longer footnote elseweher in the document [^1]: This is a long footnote..

    hide…

Want more great medical articles?

Keep up to date with a free trial of metajournal, personalized for your practice.
1,694,794 articles already indexed!

We guarantee your privacy. Your email address will not be shared.