Bmc Med Res Methodol
-
Bmc Med Res Methodol · Jan 2011
Comparative StudyLogistic random effects regression models: a comparison of statistical packages for binary and ordinal outcomes.
Logistic random effects models are a popular tool to analyze multilevel also called hierarchical data with a binary or ordinal outcome. Here, we aim to compare different statistical software implementations of these models. ⋯ On relatively large data sets, the different software implementations of logistic random effects regression models produced similar results. Thus, for a large data set there seems to be no explicit preference (of course if there is no preference from a philosophical point of view) for either a frequentist or Bayesian approach (if based on vague priors). The choice for a particular implementation may largely depend on the desired flexibility, and the usability of the package. For small data sets the random effects variances are difficult to estimate. In the frequentist approaches the MLE of this variance was often estimated zero with a standard error that is either zero or could not be determined, while for Bayesian methods the estimates could depend on the chosen "non-informative" prior of the variance parameter. The starting value for the variance parameter may be also critical for the convergence of the Markov chain.
-
Bmc Med Res Methodol · Jan 2011
Using qualitative synthesis to explore heterogeneity of complex interventions.
Including qualitative evidence on patients' perspectives in systematic reviews of complex interventions may reveal reasons for variation in trial findings. This is particularly the case when the intervention is for a long-term disease, as management may rely heavily on the efforts of the patient. Inclusion though seldom happens, possibly because of methodological challenges, and when it does occur the different forms of evidence are often kept separate. To explore heterogeneity in trial findings, we tested a novel approach to integrate qualitative review evidence on patients' perspectives with evidence from a Cochrane systematic review. ⋯ This simple approach breaks new ground in cross tabulating qualitative evidence with the characteristics of trialled interventions. In doing so it tests the assumption that patients are more likely to adhere to interventions that match more closely with their concerns. The potential of this approach in exploring varying content and rates of success in trialled complex interventions deserves further evaluation.
-
Bmc Med Res Methodol · Jan 2011
Methodological criteria for the assessment of moderators in systematic reviews of randomised controlled trials: a consensus study.
Current methodological guidelines provide advice about the assessment of sub-group analysis within RCTs, but do not specify explicit criteria for assessment. Our objective was to provide researchers with a set of criteria that will facilitate the grading of evidence for moderators, in systematic reviews. ⋯ There is consensus from a group of 21 international experts that methodological criteria to assess moderators within systematic reviews of RCTs is both timely and necessary. The consensus from the experts resulted in five criteria divided into two groups when synthesising evidence: confirmatory findings to support hypotheses about moderators and exploratory findings to inform future research. These recommendations are discussed in reference to previous recommendations for evaluating and reporting moderator studies.
-
Bmc Med Res Methodol · Jan 2011
Clinical TrialDeveloping the clinical components of a complex intervention for a glaucoma screening trial: a mixed methods study.
Glaucoma is a leading cause of avoidable blindness worldwide. Open angle glaucoma is the most common type of glaucoma. No randomised controlled trials have been conducted evaluating the effectiveness of glaucoma screening for reducing sight loss. It is unclear what the most appropriate intervention to be evaluated in any glaucoma screening trial would be. The purpose of this study was to develop the clinical components of an intervention for evaluation in a glaucoma (open angle) screening trial that would be feasible and acceptable in a UK eye-care service. ⋯ Interventions for screening for open angle glaucoma that would be feasible from a service delivery perspective were identified. Integration within an economic modelling framework explicitly highlighted the trade-off between cost-effectiveness, feasibility and equity. This study exemplifies the MRC recommendation to integrate qualitative and quantitative methods in developing complex interventions. The next step in the development pathway should encompass the views of service users.
-
Bmc Med Res Methodol · Jan 2011
Potential application of item-response theory to interpretation of medical codes in electronic patient records.
Electronic patient records are generally coded using extensive sets of codes but the significance of the utilisation of individual codes may be unclear. Item response theory (IRT) models are used to characterise the psychometric properties of items included in tests and questionnaires. This study asked whether the properties of medical codes in electronic patient records may be characterised through the application of item response theory models. ⋯ The application of item response theory models to coded electronic patient records might potentially contribute to identifying medical codes that offer poor discrimination or low calibration. This might indicate the need for improved coding sets or a requirement for improved clinical coding practice. However, in this study estimates were only obtained for a small proportion of participants and there was some evidence of poor model fit. There was also evidence of variation in the utilisation of codes between family practices raising the possibility that, in practice, properties of codes may vary for different coders.