• JAMA · Feb 1995

    Meta Analysis

    Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials.

    • K F Schulz, I Chalmers, R J Hayes, and D G Altman.
    • Division of STD/HIV Prevention, Centers for Disease Control and Prevention, Atlanta, GA 30333.
    • JAMA. 1995 Feb 1; 273 (5): 408412408-12.

    ObjectiveTo determine if inadequate approaches to randomized controlled trial design and execution are associated with evidence of bias in estimating treatment effects.DesignAn observational study in which we assessed the methodological quality of 250 controlled trials from 33 meta-analyses and then analyzed, using multiple logistic regression models, the associations between those assessments and estimated treatment effects.Data SourcesMeta-analyses from the Cochrane Pregnancy and Childbirth Database.Main Outcome MeasuresThe associations between estimates of treatment effects and inadequate allocation concealment, exclusions after randomization, and lack of double-blinding.ResultsCompared with trials in which authors reported adequately concealed treatment allocation, trials in which concealment was either inadequate or unclear (did not report or incompletely reported a concealment approach) yielded larger estimates of treatment effects (P < .001). Odds ratios were exaggerated by 41% for inadequately concealed trials and by 30% for unclearly concealed trials (adjusted for other aspects of quality). Trials in which participants had been excluded after randomization did not yield larger estimates of effects, but that lack of association may be due to incomplete reporting. Trials that were not double-blind also yielded larger estimates of effects (P = .01), with odds ratios being exaggerated by 17%.ConclusionsThis study provides empirical evidence that inadequate methodological approaches in controlled trials, particularly those representing poor allocation concealment, are associated with bias. Readers of trial reports should be wary of these pitfalls, and investigators must improve their design, execution, and reporting of trials.

      Pubmed     Full text   Copy Citation     Plaintext  

      Add institutional full text...

    Notes

     
    Knowledge, pearl, summary or comment to share?
    300 characters remaining
    help        
    You can also include formatting, links, images and footnotes in your notes
    • Simple formatting can be added to notes, such as *italics*, _underline_ or **bold**.
    • Superscript can be denoted by <sup>text</sup> and subscript <sub>text</sub>.
    • Numbered or bulleted lists can be created using either numbered lines 1. 2. 3., hyphens - or asterisks *.
    • Links can be included with: [my link to pubmed](http://pubmed.com)
    • Images can be included with: ![alt text](https://bestmedicaljournal.com/study_graph.jpg "Image Title Text")
    • For footnotes use [^1](This is a footnote.) inline.
    • Or use an inline reference [^1] to refer to a longer footnote elseweher in the document [^1]: This is a long footnote..

    hide…