Journal of the American College of Surgeons
-
Multicenter Study
Validity of the AHRQ Patient Safety Indicator "central venous catheter-related bloodstream infections".
"Central venous catheter-related bloodstream infections" (CR-BSIs) is one of the patient safety indicators (PSI 7) developed by the Agency for Healthcare Research and Quality (AHRQ) to screen for potential safety events. We sought to investigate the validity of this PSI using the medical record as the gold standard. ⋯ PSI 7 has relatively poor predictive ability for identifying true events. Coding-related issues were the main reason for the low PPV. Implementing POA codes and using more specific ICD-9-CM codes would improve its validity. As it currently stands, PSI 7 should not be used as a pay-for-performance measure, but should be limited to use in internal quality improvement efforts.
-
Multicenter Study
How valid is the AHRQ Patient Safety Indicator "postoperative hemorrhage or hematoma"?
Postoperative hemorrhage or hematoma (PHH), an Agency for Healthcare Research and Quality Patient Safety Indicator, uses administrative data to detect cases of potentially preventable postsurgical bleeding requiring a reparative procedure. How accurately it identifies true events is unknown. We therefore determined PHH's positive predictive value. ⋯ PHH's accuracy could be improved by coding enhancements, such as adopting present on admission codes or associating a timing factor with codes dealing with bleeding control. The ability of PHH to identify events representing quality of care problems requires additional evaluation.
-
Multicenter Study
Detecting patient safety indicators: How valid is "foreign body left during procedure" in the Veterans Health Administration?
The Agency for Healthcare Research and Quality (AHRQ) developed patient safety indicator (PSI) 5, "Foreign body left during procedure," to flag accidental foreign bodies in surgical and medical procedures. This study examined how well this indicator identifies true foreign body events in the Veterans Health Administration (VA). ⋯ The reported rate of foreign body events as detected by PSI 5 is low in the VA, but occurs in both surgical and medical procedures. Despite widespread implementation of surgical counts, quality improvement efforts should focus on novel ways to eliminate this "never event" from operations. Future studies are needed to better understand the preventability of medical procedure-associated foreign bodies and particularly, device failure-related foreign bodies.
-
Multicenter Study
Positive predictive value of the AHRQ Patient Safety Indicator "Postoperative Sepsis": implications for practice and policy.
Patient Safety Indicator (PSI) 13, or "Postoperative Sepsis," of the Agency for Healthcare Quality and Research (AHRQ), was recently adopted as part of a composite measure of patient safety by the Centers for Medicare and Medicaid Services (CMS). We sought to examine its positive predictive value (PPV) by determining how well it identifies true cases of postoperative sepsis. ⋯ PSI 13 has relatively poor predictive ability to identify true cases of postoperative sepsis in both the VA and nonfederal sectors. The lack of information on diagnosis timing, confusion about the definition of elective admission, and coding limitations were the major reasons for false positives. As it currently stands, the use of PSI 13 as a stand-alone measure for hospital reporting appears premature.
-
Multicenter Study
How valid is the AHRQ Patient Safety Indicator "postoperative physiologic and metabolic derangement"?
The Agency for Healthcare Research and Quality Patient Safety Indicator postoperative physiologic and metabolic derangement (PMD) uses ICD-9-CM codes to screen for potentially preventable acute kidney injury (AKI) requiring dialysis plus diabetes-related complications after elective surgery. Data on PMD's accuracy in identifying true events are limited. We examined the indicator's positive predictive value (PPV) in the Veterans Health Administration (VA). ⋯ Due to its low PPV, we recommend removing diabetes complications from the indicator and focusing on AKI. PMD's PPV could be significantly improved by using present-on-admission codes, and specific to the VA, by introduction of admission status codes. Many PMD-identified cases appeared to be at high risk based on patient- and procedure-related factors. The degree to which such cases are truly preventable events requires further assessment.