• Br J Anaesth · Nov 2024

    Randomized Controlled Trial

    Effect of machine learning models on clinician prediction of postoperative complications: the Perioperative ORACLE randomised clinical trial.

    • Bradley A Fritz, Christopher R King, Mohamed Abdelhack, Yixin Chen, Alex Kronzer, Joanna Abraham, Sandhya Tripathi, Ben AbdallahArbiADepartment of Anesthesiology, Washington University School of Medicine, Saint Louis, MO, USA., Thomas Kannampallil, Thaddeus P Budelier, Daniel Helsten, Arianna Montes de Oca, Divya Mehta, Pratyush Sontha, Omokhaye Higo, Paul Kerby, Stephen H Gregory, Troy S Wildes, and Michael S Avidan.
    • Department of Anesthesiology, Washington University School of Medicine, Saint Louis, MO, USA. Electronic address: bafritz@wustl.edu.
    • Br J Anaesth. 2024 Nov 1; 133 (5): 104210501042-1050.

    BackgroundAnaesthesiologists might be able to mitigate risk if they know which patients are at greatest risk for postoperative complications. This trial examined the impact of machine learning models on clinician risk assessment.MethodsThis single-centre, prospective, randomised clinical trial enrolled surgical patients aged ≥18 yr. Anaesthesiologists and nurse anaesthetists providing remote telemedicine support reviewed electronic health records with (assisted group) or without (unassisted group) reviewing machine learning predictions. Clinicians predicted the likelihood of postoperative 30-day all-cause mortality and postoperative acute kidney injury (AKI) within 7 days. The primary outcome was area under the receiver operating characteristic curve (AUROC) for clinician predictions of mortality and AKI, comparing AUROCs between assisted and unassisted assessments.ResultsWe analysed 5071 patients (mean [range] age: 58 [18-100] yr; 52% female) assessed by 89 clinicians. Of these, 98 (2.2%) patients died within 30 days of surgery and 450 (11.1%) patients sustained AKI. Clinician predictions agreed with the models more strongly in the assisted vs unassisted group (weighted kappa 0.75 vs 0.62 for death, mean difference: 0.13 [95% CI 0.10-0.17]; and 0.79 vs 0.54 for AKI, mean difference: 0.25 [95% CI 0.21-0.29]). Clinical prediction of death was similar between the assisted (AUROC 0.793) and unassisted (AUROC 0.780) groups (mean difference: 0.013 [95% CI -0.070 to 0.097]; P=0.76). Prediction of AKI had an AUROC of 0.734 in the assisted group vs 0.688 in the unassisted group (difference 0.046 [95% CI -0.003 to 0.091]; P=0.06).ConclusionsClinician performance was not improved by machine learning assistance. Further work is needed to clarify the role of machine learning in real-time perioperative risk stratification.Clinical Trial RegistrationNCT05042804.Copyright © 2024 British Journal of Anaesthesia. Published by Elsevier Ltd. All rights reserved.

      Pubmed     Copy Citation     Plaintext  

      Add institutional full text...

    Notes

     
    Knowledge, pearl, summary or comment to share?
    300 characters remaining
    help        
    You can also include formatting, links, images and footnotes in your notes
    • Simple formatting can be added to notes, such as *italics*, _underline_ or **bold**.
    • Superscript can be denoted by <sup>text</sup> and subscript <sub>text</sub>.
    • Numbered or bulleted lists can be created using either numbered lines 1. 2. 3., hyphens - or asterisks *.
    • Links can be included with: [my link to pubmed](http://pubmed.com)
    • Images can be included with: ![alt text](https://bestmedicaljournal.com/study_graph.jpg "Image Title Text")
    • For footnotes use [^1](This is a footnote.) inline.
    • Or use an inline reference [^1] to refer to a longer footnote elseweher in the document [^1]: This is a long footnote..

    hide…