• World Neurosurg · Aug 2024

    Bridging the Gap: Can Large Language Models Match Human Expertise in Writing Neurosurgical Operative Notes?

    • Abdullah Ali, KumarRohit PremRPDepartment of Neurological Surgery, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania, USA., Hanish Polavarapu, Raj Swaroop Lavadi, Anil Mahavadi, Andrew D Legarreta, Joseph S Hudson, Manan Shah, David Paul, James Mooney, Nicholas Dietz, Daryl P Fields, D Kojo Hamilton, and Nitin Agarwal.
    • Department of Neurological Surgery, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania, USA.
    • World Neurosurg. 2024 Aug 15.

    BackgroundProper documentation is essential for patient care. The popularity of artificial intelligence (AI) offers the potential for improvements in neurosurgical note-writing. This study aimed to assess how AI can optimize documentation in neurosurgical procedures.MethodsThirty-six operative notes were included. All identifiable data were removed. Essential information, such as perioperative data and diagnosis, was sourced from these notes. ChatGPT 4.0 was trained to draft notes from surgical vignettes using each surgeon's note template. One hundred forty-four surveys with a surgeon or AI note were shared with 3 surgeons to evaluate accuracy, content, and organization using a 5-point scale. Accuracy was defined as the factual correctness; content, as the comprehensiveness; and organization, as the arrangement of the note. Flesch-Kincaid Grade Level (FKGL) and Flesch Reading Ease (FRE) scores quantified each note's readability.ResultsThe mean AI accuracy was not different from the mean surgeon accuracy (4.44 vs. 4.33; P = 0.512), the mean AI content was lower than the mean surgeon content (3.73 vs. 4.42; P < 0.001). The mean AI note FKGL was greater than the mean surgeon FKGL (13.13 vs. 9.99; P < 0.001) and the mean AI FRE was lower than the mean surgeon FRE (21.42 vs. 41.70; P < 0.001).ConclusionsAI notes were on par with surgeon notes in terms of accuracy and organization but lacked in content. Additionally, AI notes used language at an advanced reading level. These findings support the potential for ChatGPT to enhance the efficiency of neurosurgery documentation.Copyright © 2024 Elsevier Inc. All rights reserved.

      Pubmed     Copy Citation     Plaintext  

      Add institutional full text...

    Notes

     
    Knowledge, pearl, summary or comment to share?
    300 characters remaining
    help        
    You can also include formatting, links, images and footnotes in your notes
    • Simple formatting can be added to notes, such as *italics*, _underline_ or **bold**.
    • Superscript can be denoted by <sup>text</sup> and subscript <sub>text</sub>.
    • Numbered or bulleted lists can be created using either numbered lines 1. 2. 3., hyphens - or asterisks *.
    • Links can be included with: [my link to pubmed](http://pubmed.com)
    • Images can be included with: ![alt text](https://bestmedicaljournal.com/study_graph.jpg "Image Title Text")
    • For footnotes use [^1](This is a footnote.) inline.
    • Or use an inline reference [^1] to refer to a longer footnote elseweher in the document [^1]: This is a long footnote..

    hide…