Dataset Information

Evaluation of spin in the abstracts of systematic reviews and meta-analyses of treatments and interventions for smoking cessation.

ABSTRACT:

Introduction

Smoking cessation treatments and available evidence continue to evolve. To stay current with the latest research, physicians often refer to abstracts of systematic reviews. Because abstracts of systematic reviews may have direct effects on patient care, the information within them should be free of 'spin'. Spin is a specific way of reporting, intentional or not, to highlight that the beneficial effect of the experimental treatment in terms of efficacy or safety is greater than that shown by the results (i.e. overstate efficacy and/or understate harm).

Methods

We searched systematic reviews and meta-analyses focused on interventions and treatments for smoking cessation. Full-text screening, data extraction, evaluation of spin, and quality assessment were conducted in masked, duplicate fashion. Study and journal characteristics were also recorded to determine whether they were associated with the presence of spin.

Results

A total of 200 systematic reviews that met inclusion criteria were included in the final analyses. Spin occurred in 3.5% (7/200) of the systematic review abstracts included in our sample. No study characteristics were significantly associated with spin.

Conclusions

Of the reviewed abstracts in systematic reviews and meta-analyses, 96.5% of those that focused on smoking cessation were free of spin. However, the existence of spin warrants further steps to improve the scientific accuracy of abstracts on smoking cessation treatments. By identifying and acknowledging the presence of spin in systematic reviews, we hope to increase awareness about reporting practices in an ultimate effort to improve the integrity of scientific research as a whole.

SUBMITTER: Garrett M

PROVIDER: S-EPMC8135573 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundApproximately 18 in every 100 000 people have experienced a ruptured Achilles tendon. Despite the prevalence of this condition, treatment options remain contested.Hypothesis/purposeThe objective of this study was to evaluate the use of spin-reporting practices that may exaggerate benefit or minimize harm-in abstracts of systematic reviews related to Achilles tendon repair. We also evaluated whether particular study characteristics were associated with spin.Study designCross-sectional.MethodsWe developed a search strategy for Ovid MEDLINE and Ovid Embase for systematic reviews focused on Achilles tendon treatment. Following title and abstract screening of these search returns, these reviews were evaluated for spin (according to a previously developed classification scheme) and received AMSTAR-2 (A Measurement Tool to Assess Systematic Reviews-2) appraisals by 2 investigators in a masked, duplicate manner. Study characteristics for each review were also extracted in duplicate.ResultsOur systematic search returned 251 articles of which 43 systematic reviews and meta-analyses were eligible for data extraction. We found that 65.1% of included studies contained spin (28/43). Spin type 3 was the most common type, occurring in 53.5% (23/43) of abstracts. Spin types 5, 6, 1, and 4 occurred in 16.3% (7/43), 9.3% (4/43), 7% (3/43), and 5.3% (1/43), respectively. Spin types 2, 7, 8, and 9 did not occur. AMSTAR-2 appraised 32.6% (14/43) of the studies as "moderate" quality, 32.6% (14/43) as "low" quality, and 34.9% (15/43) as "critically low" quality. No systematic reviews were rated as "high" quality. There was no significant association between the presence of spin and the following study characteristics: intervention type, article discussing Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) adherence, journal recommending PRISMA adherence, funding sources, journal 5-year impact factor, year the review was received for publication, or AMSTAR-2 critical appraisals.ConclusionSpin was present in abstracts of systematic reviews and meta-analyses-covering Achilles tendon tear treatment. Steps should be taken to improve the reporting quality of abstracts on Achilles tendon treatment as well as other common orthopedic conditions.Clinical relevanceIn order to avoid negative patient outcomes, articles should be free of spin within the abstract.

Project description:PurposeTo identify the quantity and types of spin present in systematic reviews and meta-analyses of ulnar collateral ligament reconstruction (UCLR) outcomes and to characterize the studies with spin to determine if any patterns exist.MethodsThis study was conducted per Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. In August 2022, PubMed, Scopus, and SportDiscus databases were searched using the terms "ulnar collateral ligament reconstruction" AND "systematic review" OR "meta-analysis." Each abstract was assessed for the presence of the 15 most common types of spin derived from a previously established methodology. General data that were extracted included study title, authors, publication year, journal, level of evidence, study design, funding source, reported adherence to PRISMA guidelines, preregistration of the study protocol, and methodologic quality per A Measurement Tool to Assess Systematic Reviews Version 2 (AMSTAR 2).ResultsIn total, 122 studies were identified during the preliminary search, of which 19 met the inclusion criteria. Each study had at least 1 form of spin. The most common type of spin identified was type 5 ("The conclusion claims the beneficial effect of the experimental treatment despite a high risk of bias in primary studies") (7/19, 36.8%). AMSTAR type 9 ("Did the review authors use a satisfactory technique for assessing the RoB [risk of bias] in individual studies that were included in the review?") was associated with both a lower Clarivate Impact Factor (P = .001) and a lower Scopus CiteScore (P = .015). Studies receiving external funding were associated with the failure to satisfy AMSTAR type 3 ("Did the review authors explain their selection of the study designs for inclusion in the review?") (P = .047).ConclusionsSpin is highly prevalent in the abstracts of systematic reviews and meta-analyses that investigate the outcomes of UCLR.Clinical relevanceSpin has been identified in peer-reviewed articles published on various topics, including many in orthopaedics. Systematic reviews and meta-analyses contain the most comprehensive evidence regarding a clinical question, so it is important to identify spin that may be included in these reports. Greater efforts are needed to ensure that the abstracts of papers accurately represent the results in the full text.

Project description:BackgroundRapid advancements in eHealth and mobile health (mHealth) technologies have driven researchers to design and evaluate numerous technology-based interventions to promote smoking cessation. The evolving nature of cessation interventions emphasizes a strong need for knowledge synthesis.ObjectiveThis systematic review and meta-analysis aimed to summarize recent evidence from randomized controlled trials regarding the effectiveness of eHealth-based smoking cessation interventions in promoting abstinence and assess nonabstinence outcome indicators, such as cigarette consumption and user satisfaction, via narrative synthesis.MethodsWe searched for studies published in English between 2017 and June 30, 2022, in 4 databases: PubMed (including MEDLINE), PsycINFO, Embase, and Cochrane Library. Two independent reviewers performed study screening, data extraction, and quality assessment based on the GRADE (Grading of Recommendations, Assessment, Development, and Evaluations) framework. We pooled comparable studies based on the population, follow-up time, intervention, and control characteristics. Two researchers performed an independent meta-analysis on smoking abstinence using the Sidik-Jonkman random-effects model and log risk ratio (RR) as the effect measurement. For studies not included in the meta-analysis, the outcomes were narratively synthesized.ResultsA total of 464 studies were identified through an initial database search after removing duplicates. Following screening and full-text assessments, we deemed 39 studies (n=37,341 participants) eligible for this review. Of these, 28 studies were shortlisted for meta-analysis. According to the meta-analysis, SMS or app text messaging can significantly increase both short-term (3 months) abstinence (log RR=0.50, 95% CI 0.25-0.75; I2=0.72%) and long-term (6 months) abstinence (log RR=0.77, 95% CI 0.49-1.04; I2=8.65%), relative to minimal cessation support. The frequency of texting did not significantly influence treatment outcomes. mHealth apps may significantly increase abstinence in the short term (log RR=0.76, 95% CI 0.09-1.42; I2=88.02%) but not in the long term (log RR=0.15, 95% CI -0.18 to 0.48; I2=80.06%), in contrast to less intensive cessation support. In addition, personalized or interactive interventions showed a moderate increase in cessation for both the short term (log RR=0.62, 95% CI 0.30-0.94; I2=66.50%) and long term (log RR=0.28, 95% CI 0.04-0.53; I2=73.42%). In contrast, studies without any personalized or interactive features had no significant impact. Finally, the treatment effect was similar between trials that used biochemically verified or self-reported abstinence. Among studies reporting outcomes besides abstinence (n=20), a total of 11 studies reported significantly improved nonabstinence outcomes in cigarette consumption (3/14, 21%) or user satisfaction (8/19, 42%).ConclusionsOur review of 39 randomized controlled trials found that recent eHealth interventions might promote smoking cessation, with mHealth being the dominant approach. Despite their success, the effectiveness of such interventions may diminish with time. The design of more personalized interventions could potentially benefit future studies.Trial registrationPROSPERO CRD42022347104; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=347104.

Project description:BackgroundHealthcare professionals, including nurses, frequently advise people to improve their health by stopping smoking. Such advice may be brief, or part of more intensive interventions.ObjectivesTo determine the effectiveness of nursing-delivered smoking cessation interventions in adults. To establish whether nursing-delivered smoking cessation interventions are more effective than no intervention; are more effective if the intervention is more intensive; differ in effectiveness with health state and setting of the participants; are more effective if they include follow-ups; are more effective if they include aids that demonstrate the pathophysiological effect of smoking.Search methodsWe searched the Cochrane Tobacco Addiction Group Specialized Register and CINAHL in January 2017.Selection criteriaRandomized trials of smoking cessation interventions delivered by nurses or health visitors with follow-up of at least six months.Data collection and analysisTwo review authors extracted data independently. The main outcome measure was abstinence from smoking after at least six months of follow-up. We used the most rigorous definition of abstinence for each trial, and biochemically-validated rates if available. Where statistically and clinically appropriate, we pooled studies using a Mantel-Haenszel fixed-effect model and reported the outcome as a risk ratio (RR) with a 95% confidence interval (CI).Main resultsFifty-eight studies met the inclusion criteria, nine of which are new for this update. Pooling 44 studies (over 20,000 participants) comparing a nursing intervention to a control or to usual care, we found the intervention increased the likelihood of quitting (RR 1.29, 95% CI 1.21 to 1.38); however, statistical heterogeneity was moderate (I2 = 50%) and not explained by subgroup analysis. Because of this, we judged the quality of evidence to be moderate. Despite most studies being at unclear risk of bias in at least one domain, we did not downgrade the quality of evidence further, as restricting the main analysis to only those studies at low risk of bias did not significantly alter the effect estimate. Subgroup analyses found no evidence that high-intensity interventions, interventions with additional follow-up or interventions including aids that demonstrate the pathophysiological effect of smoking are more effective than lower intensity interventions, or interventions without additional follow-up or aids. There was no evidence that the effect of support differed by patient group or across healthcare settings.Authors' conclusionsThere is moderate quality evidence that behavioural support to motivate and sustain smoking cessation delivered by nurses can lead to a modest increase in the number of people who achieve prolonged abstinence. There is insufficient evidence to assess whether more intensive interventions, those incorporating additional follow-up, or those incorporating pathophysiological feedback are more effective than one-off support. There was no evidence that the effect of support differed by patient group or across healthcare settings.

Project description:To systematically review the effectiveness of community pharmacy-delivered interventions for alcohol reduction, smoking cessation and weight management.Systematic review and meta-analyses. 10 electronic databases were searched from inception to May 2014.randomised and non-randomised controlled trials; controlled before/after studies, interrupted times series.any relevant intervention set in a community pharmacy, delivered by the pharmacy team. No restrictions on duration, country, age, or language.19 studies were included: 2 alcohol reduction, 12 smoking cessation and 5 weight management. Study quality rating: 6 'strong', 4 'moderate' and 9 'weak'. 8 studies were conducted in the UK, 4 in the USA, 2 in Australia, 1 each in 5 other countries. Evidence from 2 alcohol-reduction interventions was limited. Behavioural support and/or nicotine replacement therapy are effective and cost-effective for smoking cessation: pooled OR was 2.56 (95% CI 1.45 to 4.53) for active intervention vs usual care. Pharmacy-based interventions produced similar weight loss compared with active interventions in other primary care settings; however, weight loss was not sustained longer term in a range of primary care and commercial settings compared with control. Pharmacy-based weight management interventions have similar provider costs to those delivered in other primary care settings, which are greater than those delivered by commercial organisations. Very few studies explored if and how sociodemographic or socioeconomic variables moderated intervention effects. Insufficient information was available to examine relationships between effectiveness and behaviour change strategies, implementation factors, or organisation and delivery of interventions.Community pharmacy-delivered interventions are effective for smoking cessation, and demonstrate that the pharmacy is a feasible option for weight management interventions. Given the potential reach, effectiveness and associated costs of these interventions, commissioners should consider using community pharmacies to help deliver public health services.