Dataset Information

Vibration of effects from diverse inclusion/exclusion criteria and analytical choices: 9216 different ways to perform an indirect comparison meta-analysis.

ABSTRACT: BACKGROUND:Different methodological choices such as inclusion/exclusion criteria and analytical models can yield different results and inferences when meta-analyses are performed. We explored the range of such differences, using several methodological choices for indirect comparison meta-analyses to compare nalmefene and naltrexone in the reduction of alcohol consumption as a case study. METHODS:All double-blind randomized controlled trials (RCTs) comparing nalmefene to naltrexone or one of these compounds to a placebo in the treatment of alcohol dependence or alcohol use disorders were considered. Two reviewers searched for published and unpublished studies in MEDLINE (August 2017), the Cochrane Library, Embase, and ClinicalTrials.gov and contacted pharmaceutical companies, the European Medicines Agency, and the Food and Drug Administration. The indirect comparison meta-analyses were performed according to different inclusion/exclusion criteria (based on medical condition, abstinence of patients before inclusion, gender, somatic and psychiatric comorbidity, psychological support, treatment administered and dose, treatment duration, outcome reported, publication status, and risk of bias) and different analytical models (fixed and random effects). The primary outcome was the vibration of effects (VoE), i.e. the range of different results of the indirect comparison between nalmefene and naltrexone. The presence of a "Janus effect" was investigated, i.e. whether the 1st and 99th percentiles in the distribution of effect sizes were in opposite directions. RESULTS:Nine nalmefene and 51 naltrexone RCTs were included. No study provided a direct comparison between the drugs. We performed 9216 meta-analyses for the indirect comparison with a median of 16 RCTs (interquartile range?=?12-21) included in each meta-analysis. The standardized effect size was negative at the 1st percentile (-?0.29, favouring nalmefene) and positive at the 99th percentile (0.29, favouring naltrexone). A total of 7.1% (425/5961) of the meta-analyses with a negative effect size and 18.9% (616/3255) of those with a positive effect size were statistically significant (p?

SUBMITTER: Palpacuer C

PROVIDER: S-EPMC6747755 | biostudies-literature | 2019 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Vibration of effects from diverse inclusion/exclusion criteria and analytical choices: 9216 different ways to perform an indirect comparison meta-analysis.

Palpacuer Clément C Hammas Karima K Duprez Renan R Laviolle Bruno B Ioannidis John P A JPA Naudet Florian F

BMC medicine 20190916 1

<h4>Background</h4>Different methodological choices such as inclusion/exclusion criteria and analytical models can yield different results and inferences when meta-analyses are performed. We explored the range of such differences, using several methodological choices for indirect comparison meta-analyses to compare nalmefene and naltrexone in the reduction of alcohol consumption as a case study.<h4>Methods</h4>All double-blind randomized controlled trials (RCTs) comparing nalmefene to naltrexone ...[more]

PMID: 31526369

Similar Datasets

Project description:Clinical trials are essential parts of a medical study process, but studies are often cancelled due to a lack of participants. Clinical Trial Recruitment Support Systems are systems that help to increase the number of participants by seeking more suitable subjects. The software ATLAS (developed by Observational Health Data Sciences and Informatics) can support the launch of a clinical trial by building cohorts of patients who fulfill certain criteria. The correct use of medical classification systems aiming at clearly defined inclusion and exclusion criteria in the studies is an important pillar of this software. The aim of this investigation was to determine whether ATLAS can be used in a Clinical Trial Recruitment Support System to portray the eligibility criteria of clinical studies. Our analysis considered the number of criteria feasible for integration with ATLAS and identified its strengths and weaknesses. Additionally, we investigated whether nonrepresentable criteria were associated with the utilized terminology systems. We analyzed ATLAS using 223 objective eligibility criteria from 30 randomly selected trials conducted in the last 10 years. In the next step, we selected appropriate ICD, OPS, LOINC, or ATC codes to feed the software. We classified each criterion and study based on its implementation capability in the software, ensuring a clear and logical progression of information. Based on our observations, 51% of the analyzed inclusion criteria were fully implemented in ATLAS. Within our selected example set, 10% of the studies were classified as fully portrayable, and 73% were portrayed to some extent. Additionally, we conducted an evaluation of the software regarding its technical limitations and interaction with medical classification systems. To improve and expand the scope of criteria within a cohort definition in a practical setting, it is recommended to work closely with personnel involved in the study to define the criteria precisely and to carefully select terminology systems. The chosen criteria should be combined according to the specific setting. Additional work is needed to specify the significance and amount of the extracted criteria.

Project description:BackgroundControl-arm mortality varies between acute respiratory distress syndrome (ARDS) RCTs.MethodsWe systematically reviewed ARDS RCTs that commenced recruitment after publication of the American-European Consensus (AECC) definition (MEDLINE, Embase, and Cochrane central register of controlled trials; January 1994 to October 2020). We assessed concordance of RCT inclusion criteria to ARDS consensus definitions and whether exclusion criteria are strongly or poorly justified. We estimated the proportion of between-trial difference in control-arm 28-day mortality explained by the inclusion criteria and RCT design characteristics using meta-regression.ResultsA literature search identified 43 709 records. One hundred and fifty ARDS RCTs were included; 146/150 (97.3%) RCTs defined ARDS inclusion criteria using AECC/Berlin definitions. Deviations from consensus definitions, primarily aimed at improving ARDS diagnostic certainty, frequently related to duration of hypoxaemia (117/146; 80.1%). Exclusion criteria could be grouped by rationale for selection into strongly or poorly justified criteria. Common poorly justified exclusions included pregnancy related, age, and comorbidities (infectious/immunosuppression, hepatic, renal, and human immunodeficiency virus/acquired immunodeficiency syndrome). Control-arm 28-day mortality varied between ARDS RCTs (mean: 29.8% [95% confidence interval: 27.0-32.7%; I2=88.8%; τ2=0.02; P<0.01]), and differed significantly between RCTs with different Pao2:FiO2 ratio inclusion thresholds (26.6-39.9 kPa vs <26.6 kPa; P<0.01). In a meta-regression model, inclusion criteria and RCT design characteristics accounted for 30.6% of between-trial difference (P<0.01).ConclusionsIn most ARDS RCTs, consensus definitions are modified to use as inclusion criteria. Between-RCT mortality differences are mostly explained by the Pao2:FiO2 ratio threshold within the consensus definitions. An exclusion criteria framework can be applied when designing and reporting exclusion criteria in future ARDS RCTs.

Project description:BACKGROUND:Low back pain is a common health complaint resulting in substantial economic burden. Each year, upwards of 20 randomised controlled trials (RCTs) evaluating interventions for non-specific low back pain are published. Use of the term non-specific low back pain has been criticised on the grounds of encouraging heterogeneity and hampering interpretation of findings due to possible heterogeneous causes, challenging meta-analyses. We explored selection criteria used in trials of treatments for nsLBP. METHODS:A systematic review of English-language reports of RCTs in nsLBP population samples, published between 2006 and 2012, identified from MEDLINE, EMBASE, and the Cochrane Library databases, using a mixed-methods approach to analysis. Study inclusion and exclusion criteria were extracted, thematically categorised, and then descriptive statistics were used to summarise the prevalence by emerging category. RESULTS:We included 168 studies. Two inclusion themes (anatomical area, and symptoms and signs) were identified. Anatomical area was most reported as between costal margins and gluteal folds (n =?8, 5%), while low back pain (n =?150, 89%) with or without referred leg pain (n =?27, 16%) was the most reported symptom. Exclusion criteria comprised 21 themes. Previous or scheduled surgery (n =?84, 50%), pregnancy (n =?81, 48%), malignancy (n =?78, 46%), trauma (n =?63, 37%) and psychological conditions (n =?58, 34%) were the most common. Sub-themes of exclusion criteria mostly related to neurological signs and symptoms: nerve root compromise (n =?44, 26%), neurological signs (n =?34, 20%) or disc herniation (n =?30, 18%). Specific conditions that were most often exclusion criteria were spondylolisthesis (n =?35, 21%), spinal stenosis (n =?31, 18%) or osteoporosis (n =?27, 16%). CONCLUSION:RCTs of interventions for non-specific low back pain have incorporated diverse inclusion and exclusion criteria. Guidance on standardisation of inclusion and exclusion criteria for nsLBP trials will increase clinical homogeneity, facilitating greater interpretation of between-trial comparisons and meta-analyses. We propose a template for reporting inclusion and exclusion criteria.

Dataset Information

Vibration of effects from diverse inclusion/exclusion criteria and analytical choices: 9216 different ways to perform an indirect comparison meta-analysis.

Publications

Vibration of effects from diverse inclusion/exclusion criteria and analytical choices: 9216 different ways to perform an indirect comparison meta-analysis.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets