Dataset Information

Influence of medical journal press releases on the quality of associated newspaper coverage: retrospective cohort study.

ABSTRACT:

Objective

To determine whether the quality of press releases issued by medical journals can influence the quality of associated newspaper stories.

Design

Retrospective cohort study of medical journal press releases and associated news stories.

Setting

We reviewed consecutive issues (going backwards from January 2009) of five major medical journals (Annals of Internal Medicine, BMJ, Journal of the National Cancer Institute, JAMA, and New England Journal of Medicine) to identify the first 100 original research articles with quantifiable outcomes and that had generated any newspaper coverage (unique stories ≥100 words long). We identified 759 associated newspaper stories using Lexis Nexis and Factiva searches, and 68 journal press releases using Eurekalert and journal website searches. Two independent research assistants assessed the quality of journal articles, press releases, and a stratified random sample of associated newspaper stories (n=343) by using a structured coding scheme for the presence of specific quality measures: basic study facts, quantification of the main result, harms, and limitations.

Main outcome

Proportion of newspaper stories with specific quality measures (adjusted for whether the quality measure was present in the journal article's abstract or editor note).

Results

We recorded a median of three newspaper stories per journal article (range 1-72). Of 343 stories analysed, 71% reported on articles for which medical journals had issued press releases. 9% of stories quantified the main result with absolute risks when this information was not in the press release, 53% did so when it was in the press release (relative risk 6.0, 95% confidence interval 2.3 to 15.4), and 20% when no press release was issued (2.2, 0.83 to 6.1). 133 (39%) stories reported on research describing beneficial interventions. 24% mentioned harms (or specifically declared no harms) when harms were not mentioned in the press release, 68% when mentioned in the press release (2.8, 1.1 to 7.4), and 36% when no press release was issued (1.5, 0.49 to 4.4). 256 (75%) stories reported on research with important limitations. 16% reported any limitations when limitations were not mentioned in the press release, 48% when mentioned in the press release (3.0, 1.5 to 6.2), and 21% if no press release was issued (1.3, 0.50 to 3.6).

Conclusion

High quality press releases issued by medical journals seem to make the quality of associated newspaper stories better, whereas low quality press releases might make them worse.

SUBMITTER: Schwartz LM

PROVIDER: S-EPMC3267473 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundPrevious studies indicate that in published reports, trial results can be distorted by the use of "spin" (specific reporting strategies, intentional or unintentional, emphasizing the beneficial effect of the experimental treatment). We aimed to (1) evaluate the presence of "spin" in press releases and associated media coverage; and (2) evaluate whether findings of randomized controlled trials (RCTs) based on press releases and media coverage are misinterpreted.Methods and findingsWe systematically searched for all press releases indexed in the EurekAlert! database between December 2009 and March 2010. Of the 498 press releases retrieved and screened, we included press releases for all two-arm, parallel-group RCTs (n?=?70). We obtained a copy of the scientific article to which the press release related and we systematically searched for related news items using Lexis Nexis. "Spin," defined as specific reporting strategies (intentional or unintentional) emphasizing the beneficial effect of the experimental treatment, was identified in 28 (40%) scientific article abstract conclusions and in 33 (47%) press releases. From bivariate and multivariable analysis assessing the journal type, funding source, sample size, type of treatment (drug or other), results of the primary outcomes (all nonstatistically significant versus other), author of the press release, and the presence of "spin" in the abstract conclusion, the only factor associated, with "spin" in the press release was "spin" in the article abstract conclusions (relative risk [RR] 5.6, [95% CI 2.8-11.1], p < 0.001). Findings of RCTs based on press releases were overestimated for 19 (27%) reports. News items were identified for 41 RCTs; 21 (51%) were reported with "spin," mainly the same type of "spin" as those identified in the press release and article abstract conclusion. Findings of RCTs based on the news item was overestimated for ten (24%) reports.Conclusion"Spin" was identified in about half of press releases and media coverage. In multivariable analysis, the main factor associated with "spin" in press releases was the presence of "spin" in the article abstract conclusion.

Project description:BackgroundThe news media is a key source for health and medical information, and relies to a large degree on material from press releases (PR). Medical universities are key players in the dissemination of PRs. This study aims to 1) explore the relation between the quality of press releases (PRs) from medical universities and their corresponding news stories (NSs) and 2) to identify the likelihood that specific scientific and interest-raising measures appear or are omitted in PRs and NSs.Methods and findingsIn this retrospective study using quantitative content analysis, PRs (n = 507) from 21 medical universities in Germany, the Netherlands, Sweden, the USA and the UK were retrieved. Of all PRs, 33% had media coverage, resulting in 496 NSs. With two codebooks, 18 scientific (e.g. reporting the study design of the study correctly) and 7 interest-raising measures (e.g. words like 'ground-breaking') were evaluated in the PRs and NSs. For all measures the percentage of presence in NSs and PRs was calculated, together with a Mean PR Influence Factor. Quality of PRs and NSs was defined as a score, based on 12 of the 18 scientific measures. Mean (SD) NS quality score was 6.5 (1.7) which was significantly lower than the PR score of 8.0 (1.5). The two quality scores were significantly correlated. Quality measures that were frequently omitted included reporting important study limitations (present in 21% of PRs, 21% of NSs), funding (59% of PRs, 7% of NSs) and conflicts of interest (16% of PRs, 3% of NSs). We did not evaluate the quality of the scientific papers (SPs), and can therefore not determine if the quality of PRs and NSs is associated with the quality of SPs.ConclusionsThis large study of medical university press releases and corresponding news stories showed that important measures of a scientific study such as funding and study limitations were omitted to a very large extent. The lay public and health personnel as well as policy makers, politicians and other decision makers may be misled by incomplete and partly inaccurate representations of scientific studies which could negatively affect important health-related behaviours and decisions.