• Yuan Zhang, Pablo Alonso Coello, Gordon H Guyatt, Juan Jose Yepes-Nuñez, Elie A Akl, Glen Hazlewood, Hector Pardo-Hernandez, Itziar Etxeandia-Ikobaltzeta, Amir Qaseem, John W Williams, Peter Tugwell, Signe Flottorp, Yaping Chang, Yuqing Zhang, Reem A Mustafa, María Ximena Rojas, Feng Xie, and Holger J Schünemann.
• Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Canada.
• J Clin Epidemiol. 2019 Jul 1; 111: 83-93.

ObjectiveTo provide Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) guidance for assessing inconsistency, imprecision, and other domains for the certainty of evidence about the relative importance of outcomes.Study Design And SettingWe applied the GRADE domains to rate the certainty of evidence in the importance of outcomes to several systematic reviews, iteratively reviewed draft guidance, and consulted GRADE members and other stakeholders for feedback.ResultsWe describe the rationale for considering the remaining GRADE domains when rating the certainty in a body of evidence for the relative importance of outcomes. As meta-analyses are not common in this context, inconsistency and imprecision assessments are challenging. Furthermore, confusion exists about inconsistency, imprecision, and true variability in the relative importance of outcomes. To clarify this issue, we suggest that the true variability is neither equivalent to inconsistency nor imprecision. Specifically, inconsistency arises from population, intervention, comparison and outcome and methodological elements that should be explored and, if possible, explained. The width of the confidence interval and sample size inform judgments about imprecision. We also provide suggestions on how to detect publication bias and discuss the domains to rate up the certainty.ConclusionWe provide guidance and examples for rating inconsistency, imprecision, and other domains for a body of evidence describing the relative importance of outcomes.Copyright © 2018. Published by Elsevier Inc.

16 keywords...

hide…