Bmc Med Res Methodol
-
Bmc Med Res Methodol · Apr 2021
Crowdsourcing citation-screening in a mixed-studies systematic review: a feasibility study.
Crowdsourcing engages the help of large numbers of people in tasks, activities or projects, usually via the internet. One application of crowdsourcing is the screening of citations for inclusion in a systematic review. There is evidence that a 'Crowd' of non-specialists can reliably identify quantitative studies, such as randomized controlled trials, through the assessment of study titles and abstracts. In this feasibility study, we investigated crowd performance of an online, topic-based citation-screening task, assessing titles and abstracts for inclusion in a single mixed-studies systematic review. ⋯ It might be feasible to recruit and train a crowd to accurately perform topic-based citation-screening for mixed studies systematic reviews, though resource expended on the necessary customised training required should be factored in. In the face of long review production times, crowd screening may enable a more time-efficient conduct of reviews, with minimal reduction of citation-screening accuracy, but further research is needed.
-
Bmc Med Res Methodol · Apr 2021
The impact of grey zones on the accuracy of agreement measures for ordinal tables.
In an inter-rater agreement study, if two raters tend to rate considering different aspects of the subject of interest or have different experience levels, a grey zone occurs among the levels of a square contingency table showing the inter-rater agreement. These grey zones distort the degree of agreement between raters and negatively impact the decisions based on the inter-rater agreement tables. In this sense, it is important to know how the existence of a grey zone impacts the inter-rater agreement coefficients to choose the most reliable agreement coefficient against the grey zones to reach out with more reliable decisions. ⋯ It is observed in this study that the existence of grey zones has a significant negative impact on the accuracy of agreement measures especially for a low degree of true agreement and high sample and tables sizes. In general, Gwet's AC2 and Brennan-Prediger's κ with quadratic or ordinal weights are reliable against the grey zones.
-
Bmc Med Res Methodol · Feb 2021
LetterThe unintended consequences of COVID-19 mitigation measures matter: practical guidance for investigating them.
COVID-19 has led to the adoption of unprecedented mitigation measures which could trigger many unintended consequences. These unintended consequences can be far-reaching and just as important as the intended ones. The World Health Organization identified the assessment of unintended consequences of COVID-19 mitigation measures as a top priority. Thus far, however, their systematic assessment has been neglected due to the inattention of researchers as well as the lack of training and practical tools. ⋯ Studying the unintended consequences of COVID-19 mitigation measures is not only possible but also necessary to assess their overall value. The practical guidance presented will help program planners and evaluators gain a more comprehensive understanding of unintended consequences to refine mitigation measures.
-
Bmc Med Res Methodol · Dec 2020
Multicenter StudyUse of out-of-hospital cardiac arrest registries to assess COVID-19 home mortality.
In most countries, the official statistics for the coronavirus disease 2019 (COVID-19) take account of in-hospital deaths but not those that occur at home. The study's objective was to introduce a methodology to assess COVID-19 home deaths by analysing the French national out-of-hospital cardiac arrest (OHCA) registry (RéAC). ⋯ The ratio of COVID-19 out-of-hospital deaths to in-hospital deaths was 12.4%, and so the national statistics underestimated the death rate.
-
Bmc Med Res Methodol · Nov 2020
Patient-specific record linkage between emergency department and hospital admission data for a cohort of people who inject drugs: methodological considerations for frequent presenters.
People who inject drugs (PWID) have been identified as frequent users of emergency department (ED) and hospital inpatient services. The specific challenges of record linkage in cohorts with numerous administrative health records occurring in close proximity are not well understood. Here, we present a method for patient-specific record linkage of ED and hospital admission data for a cohort of PWID. ⋯ Linking ED visits with subsequent hospital admissions in PWID requires access to date and time variables for accurate temporal sorting, especially for same-day presentations. Selecting time-windows to capture linked records requires discretion. Researchers risk under-ascertainment of hospital admissions if using ED data alone.