• R Barker Bausell, Wen-Lin Lee, Karen L Soeken, Yu-Fang Li, and Brian M Berman.
• University of Maryland School of Nursing, Baltimore, MD 21201, USA. bbausell@compmed.umm.edu
• J Clin Epidemiol. 2004 May 1; 57 (5): 438-46.

ObjectiveTo determine if the quality of complementary and alternative medicine (CAM) placebo controlled randomized controlled trials (RCTs) is related to the effect sizes they produce when the type of interventions and outcome variables are controlled.Study Design And SettingA sample of 25 CAM meta-analyses was identified from MEDLINE and hand searches containing published effect sizes for at least three efficacy trials employing placebo control groups. From these 25 reviews, 26 pairs of trials were selected: the one reporting the largest effect size and the matching trial reporting the smallest effect size. Quality and publication characteristics were then abstracted from each trial.ResultsUnlike the preponderance of past evidence examining the relationship between quality and effect size, the present study found that trials possessing the largest effect sizes within a meta-analysis were also associated with higher quality ratings than their counterparts possessing the lowest effect sizes (P=.019).ConclusionsPossible theoretical reasons for this unexpected positive relationship include (a) sampling error, (b) reduced within group variation, (c) fraudulent reporting, and (d) the restriction of the analyses to placebo controlled trial.

10 keywords...

hide…