Systematic reviews
-
There are both theoretical and empirical reasons to believe that design and execution factors are associated with bias in controlled trials. Statistically significant moderator effects, such as the effect of trial quality on treatment effect sizes, are rarely detected in individual meta-analyses, and evidence from meta-epidemiological datasets is inconsistent. The reasons for the disconnect between theory and empirical observation are unclear. The study objective was to explore the power to detect study level moderator effects in meta-analyses. ⋯ Although study characteristics, such as trial quality, may explain some proportion of heterogeneity across study results in meta-analyses, residual heterogeneity is a crucial factor in determining when associations between moderator variables and effect sizes can be statistically detected. Detecting moderator effects requires more powerful analyses than are employed in most published investigations; hence negative findings should not be considered evidence of a lack of effect, and investigations are not hypothesis-proving unless power calculations show sufficient ability to detect effects.
-
Systematic reviews (SRs) can become outdated as new evidence emerges over time. Organizations that produce SRs need a surveillance method to determine when reviews are likely to require updating. This report describes the development and initial results of a surveillance system to assess SRs produced by the Agency for Healthcare Research and Quality (AHRQ) Evidence-based Practice Center (EPC) Program. ⋯ In this system of regular surveillance of 24 systematic reviews on a variety of clinical interventions produced by a leading organization, about 70% of reviews were determined to have a low priority for updating. Evidence suggests that the time period for surveillance is yearly rather than the six months used in this project.
-
Accountability has center stage in the current post-Millennium Development Goals (MDG) debate. One of the effective strategies for building equitable health systems and providing quality health services is the strengthening of citizen-driven or social accountability processes. The monitoring of actions and decisions of policymakers and providers by citizens is regarded as a right in itself but also as an alternative to weak administrative accountability mechanisms, in particular in settings with poor governance. The effects of social accountability interventions are often based on assumptions and are difficult to evaluate because of their complex nature and context sensitivity. This study aims to review and assess the available evidence for the effect of social accountability interventions on policymakers' and providers' responsiveness in countries with medium to low levels of governance capacity and quality. For policymakers and practitioners engaged in health system strengthening, social accountability initiatives and rights-based approaches to health, the findings of this review may help when reflecting on the assumptions and theories of change behind their policies and interventions. ⋯ The authors believe the advantages of a realist synthesis for social accountability lie in the possibility of overcoming disciplinary or paradigmatic boundaries often found in public health and development. In addition, they argue that this approach fills the knowledge gap left by conventional synthesis or evaluation exercises of participatory programs. Finally, the authors describe the practical strategies adopted to address methodological challenges and validity.