• Leath Abdullah, Daniel E Davis, Peter D Fabricant, Keith Baldwin, and Surena Namdari.
• Drexel University College of Medicine, 2900 West Queen Lane, Philadelphia, PA 19129.
• J Bone Joint Surg Am. 2015 Dec 16; 97 (24): 2068-73.

BackgroundRandomized controlled trials (RCTs) are considered the gold standard in evidence-based medicine. Underpowered RCTs that describe comparative outcomes without significance are of questionable benefit. The present study hypothesizes that a substantial proportion of RCTs in the orthopaedic literature that do not note significant differences between groups are inadequately powered.MethodsUsing the ISI Web of Science database, we searched all English-language journals in the orthopaedic category for RCTs published from January 2012 to December 2013. Qualifying articles were analyzed with regard to whether the null hypothesis was rejected (a positive study) for the primary outcome or if it was not (a negative study), whether a power analysis was performed, and whether the study was adequately powered. We performed a power analysis based on the primary outcome or outcomes of interest for the studies that did not describe a power analysis.ResultsAfter inclusion and exclusion criteria were applied, 456 RCTs were selected for complete review. Of those studies, 215 (47.1%) had negative findings and 241 (52.9%) had positive findings for primary outcomes. Twenty-five studies that failed to reject the null hypothesis noted inadequate power in the study. On the basis of our own power analyses, we found an additional thirty-five negative studies without power calculations to be underpowered. Sixty (27.9%) of the 215 negative studies were underpowered. Following binary logistic regression, only the journal impact factor was a significant predictor of whether a study was underpowered.ConclusionsIf an RCT lacks adequate statistical power to identify a clinically meaningful absence of a difference between groups, there is an unacceptable risk of inappropriately failing to reject the null hypothesis. The present study found that a sizable proportion of RCTs in orthopaedic surgery in which the null hypothesis is rejected are inadequately powered. Researchers should consider this when designing clinical trials, and journal editors and reviewers should be wary of underpowered RCTs when considering manuscripts for publication.Copyright © 2015 by The Journal of Bone and Joint Surgery, Incorporated.

12 keywords...

hide…