• CJEM · Feb 2025

    Review

    Establishing methodological standards for the development of artificial intelligence-based Clinical Decision Support in emergency medicine.

    • Hashim Kareemi, Henry Li, Akshay Rajaram, Jessalyn K Holodinsky, Justin N Hall, Lars Grant, Gautam Goel, Jake Hayward, Shaun Mehta, Maxim Ben-Yakov, PelletierElyse BergerEBDepartment of Family Medicine and Emergency Medicine, Université Laval, Quebec, QC, Canada.Department of Emergency Medicine, CIUSSS, Chaudière-Appalaches, Quebec, QC, Canada., Frank Scheuermeyer, and Kendall Ho.
    • Department of Emergency Medicine, University of British Columbia, Vancouver, BC, Canada. hashim.kareemi@vch.ca.
    • CJEM. 2025 Feb 7.

    ObjectiveArtificial intelligence (AI) offers opportunities for managing the complexities of clinical care in the emergency department (ED), and Clinical Decision Support has been identified as a priority application. However, there is a lack of published guidance on how to rigorously develop and evaluate these tools. We sought to answer the question, "What methodological standards should be applied to the development of AI-based Clinical Decision Support tools in the ED?".MethodsWe conducted an iterative consensus-establishing activity involving a subcommittee with AI expertise followed by surveys and a live facilitated discussion with participants of the 2024 Canadian Association of Emergency Physicians Research Symposium in Saskatoon. We augmented analysis of participant feedback with large language models.ResultsWe established 11 recommendations AI-based Clinical Decision Support development including the selection of a relevant problem and team of experts, standards of data quality and quantity, novel AI-specific reporting guidelines, and adherence to principles of ethics and privacy. We removed the recommendation regarding model interpretability from the final list due to a lack of consensus.ConclusionThese 11 recommendations provide guiding principles and methodological standards for emergency medicine researchers to rigorously develop AI-based Clinical Decision Support tools and for clinicians to gain knowledge and trust in using them.© 2025. The Author(s), under exclusive licence to the Canadian Association of Emergency Physicians (CAEP)/ Association Canadienne de Médecine d'Urgence (ACMU).

      Pubmed     Copy Citation     Plaintext  

      Add institutional full text...

    Notes

     
    Knowledge, pearl, summary or comment to share?
    300 characters remaining
    help        
    You can also include formatting, links, images and footnotes in your notes
    • Simple formatting can be added to notes, such as *italics*, _underline_ or **bold**.
    • Superscript can be denoted by <sup>text</sup> and subscript <sub>text</sub>.
    • Numbered or bulleted lists can be created using either numbered lines 1. 2. 3., hyphens - or asterisks *.
    • Links can be included with: [my link to pubmed](http://pubmed.com)
    • Images can be included with: ![alt text](https://bestmedicaljournal.com/study_graph.jpg "Image Title Text")
    • For footnotes use [^1](This is a footnote.) inline.
    • Or use an inline reference [^1] to refer to a longer footnote elseweher in the document [^1]: This is a long footnote..

    hide…