Dataset Information

Interpretation of health news items reported with or without spin: protocol for a prospective meta-analysis of 16 randomised controlled trials.

ABSTRACT: INTRODUCTION:We aim to compare the interpretation of health news items reported with or without spin. 'Spin' is defined as a misrepresentation of study results, regardless of motive (intentionally or unintentionally) that overemphasises the beneficial effects of the intervention and overstates safety compared with that shown by the results. METHODS AND ANALYSIS:We have planned a series of 16 randomised controlled trials (RCTs) to perform a prospective meta-analysis. We will select a sample of health news items reporting the results of four types of study designs, evaluating the effect of pharmacological treatment and containing the highest amount of spin in the headline and text. News items reporting four types of studies will be included: (1) preclinical studies; (2) phase I/II (non-randomised) trials; (3) RCTs and (4) observational studies. We will rewrite the selected news items and remove the spin. The original news and rewritten news will be appraised by four types of populations: (1) French-speaking patients; (2) French-speaking general public; (3) English-speaking patients and (4) English-speaking general public. Each RCT will explore the interpretation of news items reporting one of the four study designs by each type of population and will include a sample size of 300 participants. The primary outcome will be participants' interpretation of the benefit of treatment after reading the news items: (What do you think is the probability that treatment X would be beneficial to patients? (scale, 0 (very unlikely) to 10 (very likely)).This study will evaluate the impact of spin on the interpretation of health news reporting results of studies by patients and the general public. ETHICS AND DISSEMINATION:This study has obtained ethics approval from the Institutional Review Board of the Institut national de la santé et de la recherche médicale (INSERM) (registration no: IRB00003888). The description of all the steps and the results of this prospective meta-analysis will be available online and will be disseminated as a published article. On the completion of this study, the results will be sent to all participants. PROSPERO REGISTRATION NUMBER:CRD42017058941.

SUBMITTER: Haneef R

PROVIDER: S-EPMC5702017 | biostudies-other | 2017 Nov

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Interpretation of health news items reported with or without spin: protocol for a prospective meta-analysis of 16 randomised controlled trials.

Haneef Romana R Yavchitz Amélie A Ravaud Philippe P Baron Gabriel G Oransky Ivan I Schwitzer Gary G Boutron Isabelle I

BMJ open 20171117 11

<h4>Introduction</h4>We aim to compare the interpretation of health news items reported with or without spin. 'Spin' is defined as a misrepresentation of study results, regardless of motive (intentionally or unintentionally) that overemphasises the beneficial effects of the intervention and overstates safety compared with that shown by the results.<h4>Methods and analysis</h4>We have planned a series of 16 randomised controlled trials (RCTs) to perform a prospective meta-analysis. We will select ...[more]

PMID: 29151047

Similar Datasets

Project description:BackgroundNews stories represent an important source of information. We aimed to evaluate the impact of "spin" (i.e., misrepresentation of study results) in health news stories reporting studies of pharmacologic treatments on patients'/caregivers' interpretation of treatment benefit.MethodsWe conducted three two-arm, parallel-group, Internet-based randomized trials (RCTs) comparing the interpretation of news stories reported with or without spin. Each RCT considered news stories reporting a different type of study: (1) pre-clinical study, (2) phase I/II non-RCT, and (3) phase III/IV RCT. For each type of study, we identified news stories reported with spin that had earned mention in the press. Two versions of the news stories were used: the version with spin and a version rewritten without spin. Participants were patients/caregivers involved in Inspire, a large online community of more than one million patients/caregivers. The primary outcome was participants' interpretation assessed by one specific question "What do you think is the probability that 'treatment X' would be beneficial to patients?" (scale, 0 [very unlikely] to 10 [very likely]).ResultsFor each RCT, 300 participants were randomly assigned to assess a news story with spin (n = 150) or without spin (n = 150), and 900 participants assessed a news story. Participants were more likely to consider that the treatment would be beneficial to patients when the news story was reported with spin. The mean (SD) score for the primary outcome for abstracts reported with and without spin for pre-clinical studies was 7.5 (2.2) versus 5.8 (2.8) (mean difference [95% CI] 1.7 [1.0-2.3], p < 0.001); for phase I/II non-randomized trials, 7.6 (2.2) versus 5.8 (2.7) (mean difference 1.8 [1.0-2.5], p < 0.001); and for phase III/IV RCTs, 7.2 (2.3) versus 4.9 (2.8) (mean difference 2.3 [1.4-3.2], p < 0.001).ConclusionsSpin in health news stories reporting studies of pharmacologic treatments affects patients'/caregivers' interpretation.Trial registrationClinicalTrials.gov, NCT03094078 , NCT03094104 , NCT03095586.

Project description:IntroductionResearch in medical education has increased in volume over the past decades but concerns have been raised regarding the quality of trials conducted within this field. Randomised controlled trials (RCTs) involving educational interventions that are reported in biomedical journals have been criticised for their insufficient conceptual, theoretical framework. RCTs published in journals dedicated to medical education, on the other hand, have been questioned regarding their methodological rigour. The aim of this study is therefore to assess the quality of RCTs of educational interventions reported in 2012 and 2013 in journals dedicated to medical education compared to biomedical journals with respect to objective quality criteria.Methods and analysisRCTs published between 1 January 2012 and 31 December 2013 in English are included. The search strategy is developed with the help of experienced librarians to search online databases for key terms. All of the identified RCTs are screened based on their titles and abstracts individually by the authors and then compared in pairs to assess agreement. Data are extracted from the included RCTs by independently scoring each RCT using a data collection form. The data collection form consists of four steps. Step 1 includes confirmation of RCT eligibility; step 2 consists of the CONSORT checklist; step 3 consists of the Medical Education Research Study Quality Instrument framework; step 4 consists of a Medical Education Extension (MEdEx) to the CONSORT checklist. The MEdEx includes the following elements: Description of scientific background, explanation of rationale, quality of research questions and hypotheses, clarity in the description of the use of the intervention and control as well as interpretation of results.Ethics and disseminationThis review is the first to systematically examine the quality of RCTs conducted in medical education. We plan to disseminate the results through publications and presentation at relevant conferences. Ethical approval is not sought for this review.

Project description:IntroductionDiabetes mellitus is the most common metabolic complication of pregnancy and its prevalence worldwide is rising. The number of randomised controlled trials (RCTs) being conducted in people with diabetes is also increasing. Many studies preferentially publish findings on clinical endpoints and do not report patient-reported outcomes (PROs). In studies that do include PROs, PRO reporting is often of poor quality.MethodsWe will conduct this systematic review following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Using a combination of medical subject headings and keywords (combined using Boolean operators), we will search web-based databases (PubMed, Cochrane and EMBASE) for RCTs published in English between 2013 and 2021. Two reviewers will review titles and abstracts. We will review the full texts of any relevant abstracts and extract the following data: date of publication or recruitment period, journal of publication, country of study, multicentre or single centre, population and number of participants, type of intervention, frequency of PRO assessment and type of PRO (or PRO measurement) used. We will also record if the PRO was a primary, secondary or exploratory outcome. We will exclude reviews, observational studies, unpublished data for example, conference abstracts and trial protocols. Any published RCT that includes data on a PRO as a primary or secondary outcome will then be compared against the Consolidated Standards of Reporting Trials-Patient-Reported Outcome extension checklist, a structured and approved framework for the publication of results of PROs.Ethics and disseminationEthical approval to conduct this study was obtained from the ethics committee at Galway University Hospitals on 24 March 2021 (CA 2592). We aim to publish our findings in a peer-reviewed journal and present our findings at national and international conferences.Systematic review registrationThis systematic review was registered prospectively with the International Prospective Register of Systematic Reviews (PROSPERO). Registration number CRD42021234917.

Project description:Establishing the invariance property of an instrument (e.g., a questionnaire or test) is a key step for establishing its measurement validity. Measurement invariance is typically assessed by differential item functioning (DIF) analysis, i.e., detecting DIF items whose response distribution depends not only on the latent trait measured by the instrument but also on the group membership. DIF analysis is confounded by the group difference in the latent trait distributions. Many DIF analyses require knowing several anchor items that are DIF-free in order to draw inferences on whether each of the rest is a DIF item, where the anchor items are used to identify the latent trait distributions. When no prior information on anchor items is available, or some anchor items are misspecified, item purification methods and regularized estimation methods can be used. The former iteratively purifies the anchor set by a stepwise model selection procedure, and the latter selects the DIF-free items by a LASSO-type regularization approach. Unfortunately, unlike the methods based on a correctly specified anchor set, these methods are not guaranteed to provide valid statistical inference (e.g., confidence intervals and p-values). In this paper, we propose a new method for DIF analysis under a multiple indicators and multiple causes (MIMIC) model for DIF. This method adopts a minimal [Formula: see text] norm condition for identifying the latent trait distributions. Without requiring prior knowledge about an anchor set, it can accurately estimate the DIF effects of individual items and further draw valid statistical inferences for quantifying the uncertainty. Specifically, the inference results allow us to control the type-I error for DIF detection, which may not be possible with item purification and regularized estimation methods. We conduct simulation studies to evaluate the performance of the proposed method and compare it with the anchor-set-based likelihood ratio test approach and the LASSO approach. The proposed method is applied to analysing the three personality scales of the Eysenck personality questionnaire-revised (EPQ-R).

Project description:BackgroundThe "real" effect size of a medical therapy is constant over time. In contrast, the effect size reported in randomised controlled trials (RCTs) may change over time because the sum of all kinds of bias influencing the reported effectiveness is not necessarily constant. As this would affect the validity of meta-analyses, we tested the hypothesis that the reported effect size decreases over time. Furthermore, we tested three hypotheses that would explain a possible change.MethodsBecause of well established outcome measures, the lipid-lowering drugs Pravastatin and Atorvastatin (serum low-density lipoprotein cholesterol, LDL-C) and the anti-glaucoma drugs Timolol and Latanoprost (intraocular pressure, IOP) were chosen for this investigation. Studies were identified by a standardized MEDLINE search. RCTs investigating the above identified medications administered as monotherapy, and in defined dosages, were included. Publication year, baseline (= pre-treatment value in the treatment group of interest) and post intervention means, number of patients and the assignment to experimental or control group were extracted for each study.ResultsA total of 625 citations were screened; 206 met the inclusion criteria. The reported effect size of Pravastatin (change of reported effect size in five years: -3.22% LDL-C, P < .0001), Timolol (-0.56 mmHg, P < .0001) and Latanoprost (-1.78 mmHg, P = .0074) decreased over time, while there was no significant change for Atorvastatin (+0.31% LDL-C, P = .8618). Multiple regression analysis showed that baseline values were the most important influencing factor; study size or treatment group did not play a significant role.ConclusionThe effectiveness of medical therapies reported in RCTs decreases over time in three of the four investigated pharmaceuticals, caused mainly by baseline differences. We call this phenomenon "fading of reported effectiveness". Under this condition the validity of a meta-analysis may be impaired. Therefore we propose to observe this phenomenon in future meta-analyses in order to guarantee a maximum of transparency.

Dataset Information

Interpretation of health news items reported with or without spin: protocol for a prospective meta-analysis of 16 randomised controlled trials.

Publications

Interpretation of health news items reported with or without spin: protocol for a prospective meta-analysis of 16 randomised controlled trials.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets