• Resuscitation · Jul 2012

    The Simulation Team Assessment Tool (STAT): development, reliability and validation.

    • Jennifer Reid, Kimberly Stone, Julie Brown, Derya Caglar, Ana Kobayashi, Mithya Lewis-Newby, Rebecca Partridge, Kristy Seidel, and Linda Quan.
    • Emergency Services, Seattle Children’s Hospital, Seattle, WA, 98105, United States. Jennifer.reid@seattlechildrens.org
    • Resuscitation. 2012 Jul 1;83(7):879-86.

    IntroductionSimulation sessions prepare medical professionals for pediatric emergencies. No validated tools exist to evaluate overall team performance. Our objective was to develop and evaluate the inter-rater reliability and validity of a team performance assessment tool during simulated pediatric resuscitations.MethodsWe developed the Simulation Team Assessment Tool (STAT) which evaluated 4 domains: basic assessment skills, airway/breathing, circulation, and human factors. Scoring of each element was behaviorally anchored from 0 to 2 points. Two teams of resuscitation experts and two teams of pediatric residents performed the same simulated pediatric resuscitation. Each team was scored by six raters using the STAT. Intraclass correlation coefficients (ICC) were calculated to assess inter-rater reliability. Overall performance and domain scores between expert and resident teams were compared using repeated measures of analysis of variance to assess construct validity.ResultsICCs for overall performance were 0.81. Domain ICCs were: basic skills 0.73, airway/breathing skills 0.30, circulation skills 0.76, human factors 0.68. Expert versus resident average scores were: overall performance 84% vs. 66% (p=0.02), basic skills 73% vs. 55% (p<0.01); airway 80% vs. 75% (p=0.25), circulation 90% vs. 69% (p=0.02), human factors 89% vs. 66% (p=0.02).ConclusionsThe STAT's overall performance, basic skills, circulation, and human factors domains had good to excellent inter-rater reliability, discriminating well between expert and resident teams. Similar performance in the airway/breathing domain among all teams magnified the impact of a small number of rater disagreements on the ICC. Additional study is needed to better assess the airway/breathing domain.Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

      Pubmed     Full text   Copy Citation     Plaintext  

      Add institutional full text...

    Notes

     
    Knowledge, pearl, summary or comment to share?
    300 characters remaining
    help        
    You can also include formatting, links, images and footnotes in your notes
    • Simple formatting can be added to notes, such as *italics*, _underline_ or **bold**.
    • Superscript can be denoted by <sup>text</sup> and subscript <sub>text</sub>.
    • Numbered or bulleted lists can be created using either numbered lines 1. 2. 3., hyphens - or asterisks *.
    • Links can be included with: [my link to pubmed](http://pubmed.com)
    • Images can be included with: ![alt text](https://bestmedicaljournal.com/study_graph.jpg "Image Title Text")
    • For footnotes use [^1](This is a footnote.) inline.
    • Or use an inline reference [^1] to refer to a longer footnote elseweher in the document [^1]: This is a long footnote..

    hide…