Dataset Information

Evaluation of Spin in the Abstracts of Systematic Reviews and Meta-analyses Covering Treatments for Achilles Tendon Ruptures.

ABSTRACT:

Background

Approximately 18 in every 100 000 people have experienced a ruptured Achilles tendon. Despite the prevalence of this condition, treatment options remain contested.

Hypothesis/purpose

The objective of this study was to evaluate the use of spin-reporting practices that may exaggerate benefit or minimize harm-in abstracts of systematic reviews related to Achilles tendon repair. We also evaluated whether particular study characteristics were associated with spin.

Study design

Cross-sectional.

Methods

We developed a search strategy for Ovid MEDLINE and Ovid Embase for systematic reviews focused on Achilles tendon treatment. Following title and abstract screening of these search returns, these reviews were evaluated for spin (according to a previously developed classification scheme) and received AMSTAR-2 (A Measurement Tool to Assess Systematic Reviews-2) appraisals by 2 investigators in a masked, duplicate manner. Study characteristics for each review were also extracted in duplicate.

Results

Our systematic search returned 251 articles of which 43 systematic reviews and meta-analyses were eligible for data extraction. We found that 65.1% of included studies contained spin (28/43). Spin type 3 was the most common type, occurring in 53.5% (23/43) of abstracts. Spin types 5, 6, 1, and 4 occurred in 16.3% (7/43), 9.3% (4/43), 7% (3/43), and 5.3% (1/43), respectively. Spin types 2, 7, 8, and 9 did not occur. AMSTAR-2 appraised 32.6% (14/43) of the studies as "moderate" quality, 32.6% (14/43) as "low" quality, and 34.9% (15/43) as "critically low" quality. No systematic reviews were rated as "high" quality. There was no significant association between the presence of spin and the following study characteristics: intervention type, article discussing Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) adherence, journal recommending PRISMA adherence, funding sources, journal 5-year impact factor, year the review was received for publication, or AMSTAR-2 critical appraisals.

Conclusion

Spin was present in abstracts of systematic reviews and meta-analyses-covering Achilles tendon tear treatment. Steps should be taken to improve the reporting quality of abstracts on Achilles tendon treatment as well as other common orthopedic conditions.

Clinical relevance

In order to avoid negative patient outcomes, articles should be free of spin within the abstract.

SUBMITTER: Carr M

PROVIDER: S-EPMC8702684 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:PurposeTo identify the quantity and types of spin present in systematic reviews and meta-analyses of ulnar collateral ligament reconstruction (UCLR) outcomes and to characterize the studies with spin to determine if any patterns exist.MethodsThis study was conducted per Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. In August 2022, PubMed, Scopus, and SportDiscus databases were searched using the terms "ulnar collateral ligament reconstruction" AND "systematic review" OR "meta-analysis." Each abstract was assessed for the presence of the 15 most common types of spin derived from a previously established methodology. General data that were extracted included study title, authors, publication year, journal, level of evidence, study design, funding source, reported adherence to PRISMA guidelines, preregistration of the study protocol, and methodologic quality per A Measurement Tool to Assess Systematic Reviews Version 2 (AMSTAR 2).ResultsIn total, 122 studies were identified during the preliminary search, of which 19 met the inclusion criteria. Each study had at least 1 form of spin. The most common type of spin identified was type 5 ("The conclusion claims the beneficial effect of the experimental treatment despite a high risk of bias in primary studies") (7/19, 36.8%). AMSTAR type 9 ("Did the review authors use a satisfactory technique for assessing the RoB [risk of bias] in individual studies that were included in the review?") was associated with both a lower Clarivate Impact Factor (P = .001) and a lower Scopus CiteScore (P = .015). Studies receiving external funding were associated with the failure to satisfy AMSTAR type 3 ("Did the review authors explain their selection of the study designs for inclusion in the review?") (P = .047).ConclusionsSpin is highly prevalent in the abstracts of systematic reviews and meta-analyses that investigate the outcomes of UCLR.Clinical relevanceSpin has been identified in peer-reviewed articles published on various topics, including many in orthopaedics. Systematic reviews and meta-analyses contain the most comprehensive evidence regarding a clinical question, so it is important to identify spin that may be included in these reports. Greater efforts are needed to ensure that the abstracts of papers accurately represent the results in the full text.

Project description:Background:The management of acute Achilles tendon ruptures is controversial, and most injuries are treated with surgery in the USA. The cost utility of operative versus non-operative treatment of acute Achilles tendon injury is unclear. Questions/Purposes:The purpose of this study was to compare the cost-effectiveness of operative versus functional non-operative treatment of acute Achilles tendon ruptures. Methods:A Markov cost-utility analysis was conducted from the societal perspective using a 2-year time horizon. Hospital costs were derived from New York State billing data, and physician and rehabilitation costs were derived from the Medicare physician fee schedule. Indirect costs of missed work were calculated using estimates from the US Bureau of Labor Statistics. Rates of re-rupture, major and minor complications, and the associated costs were obtained from the literature. Effectiveness was expressed in quality-adjusted life years (QALYs). For the base-case analysis, operative and non-operative patients were assumed to have the same utilities (quality of life) following surgery. Deterministic and probabilistic sensitivity analyses were conducted to evaluate the robustness of model assumptions. Results:In the base-case model, non-operative management of acute Achilles tendon ruptures dominated operative management, resulting in both lower costs and greater QALY gains. The differences in costs and effectiveness were relatively small. The benefit of non-operative treatment was 1.69 QALYs, and the benefit of operative treatment was 1.67 QALYs. Similarly, the total cost of operative and non-operative management was $13,936 versus $13,413, respectively. In sensitivity analyses, surgical costs and days of missed work were important drivers of cost-effectiveness. If hospitalization costs dropped below $2621 (compared with $3145) or the hourly wage rose above $29 (compared with $24), then operative treatment became a cost-effective strategy at the willingness-to-pay threshold of $50,000/QALY. The model results were also highly sensitive to the relative utilities for operative versus non-operative treatment. If non-operative utilities decreased relative to operative utilities by just 2%, then operative management became the dominant treatment strategy. Conclusion:For acute Achilles tendon ruptures, non-operative treatment provided greater benefits and lower costs than operative management in the base case; however, surgical costs and the economic impact associated with return to work are important determinants of the preferred cost-effective strategy.

Project description:BackgroundAchilles tendon ruptures are a common injury and are increasing in incidence. Several management strategies exist for both non-operative and operative care, with each strategy offering unique risks and benefits. Traditional pairwise meta-analyses have been performed to compare management strategies; however, all treatment options have never been integrated in a single analysis. Network meta-analysis (NMA) is a generalization of pairwise meta-analysis, which allows for the comparison of multiple interventions based on all available direct and indirect evidence. The objectives of this review are to synthesize the evidence on the management options for acute Achilles tendon rupture and identify which treatment gives the best functional outcomes.MethodsA systematic review with NMA is planned. An electronic literature search will be performed in conjunction with an experienced information specialist in MEDLINE, EMBASE, CINAHL, PEDro, and the Cochrane Central Register of Controlled Trials. We will include randomized controlled trials with a minimum 6-month follow-up. Two independent reviewers will screen citations for eligibility, extract study data, and perform risk of bias assessments. The primary outcome will be disease-specific functional outcome scores (AOFAS, Leppilahti, modified Leppilahti) at 1 year. Secondary outcomes will include complications (re-rupture, sural nerve injury, wound complications, deep infection, secondary surgeries), strength, range of motion, return to work, return to sport, and quality-of-life measures (including the SF-36 questionnaire). Traditional pairwise meta-analyses will be performed for all direct comparisons where evidence is available, and NMAs will subsequently be performed where possible to compare all management strategies.DiscussionThe data generated from this review will provide health-care providers with a clear evidence synthesis of all Achilles tendon rupture management strategies. Additionally, these data will be incorporated into the development of a patient decision aid to assist patients and clinicians in making a preference-based decision when faced with an Achilles tendon rupture.Systematic review registrationPROSPERO CRD42018093033 .

Project description:ObjectivesTo compare re-rupture rate, complication rate, and functional outcome after operative versus nonoperative treatment of Achilles tendon ruptures; to compare re-rupture rate after early and late full weight bearing; to evaluate re-rupture rate after functional rehabilitation with early range of motion; and to compare effect estimates from randomised controlled trials and observational studies.DesignSystematic review and meta-analysis.Data sourcesPubMed/Medline, Embase, CENTRAL, and CINAHL databases were last searched on 25 April 2018 for studies comparing operative versus nonoperative treatment of Achilles tendon ruptures.Study selection criteriaRandomised controlled trials and observational studies reporting on comparison of operative versus nonoperative treatment of acute Achilles tendon ruptures.Data extractionData extraction was performed independently in pairs, by four reviewers, with the use of a predefined data extraction file. Outcomes were pooled using random effects models and presented as risk difference, risk ratio, or mean difference, with 95% confidence interval.Results29 studies were included-10 randomised controlled trials and 19 observational studies. The 10 trials included 944 (6%) patients, and the 19 observational studies included 14?918 (94%) patients. A significant reduction in re-ruptures was seen after operative treatment (2.3%) compared with nonoperative treatment (3.9%) (risk difference 1.6%; risk ratio 0.43, 95% confidence interval 0.31 to 0.60; P<0.001; I2=22%). Operative treatment resulted in a significantly higher complication rate than nonoperative treatment (4.9% v 1.6%; risk difference 3.3%; risk ratio 2.76, 1.84 to 4.13; P<0.001; I2=45%). The main difference in complication rate was attributable to the incidence of infection (2.8%) in the operative group. A similar reduction in re-rupture rate in favour of operative treatment was seen after both early and late full weight bearing. No significant difference in re-rupture rate was seen between operative and nonoperative treatment in studies that used accelerated functional rehabilitation with early range of motion (risk ratio 0.60, 0.26 to 1.37; P=0.23; I2=0%). No difference in effect estimates was seen between randomised controlled trials and observational studies.ConclusionsThis meta-analysis shows that operative treatment of Achilles tendon ruptures reduces the risk of re-rupture compared with nonoperative treatment. However, re-rupture rates are low and differences between treatment groups are small (risk difference 1.6%). Operative treatment results in a higher risk of other complications (risk difference 3.3%). The final decision on the management of acute Achilles tendon ruptures should be based on patient specific factors and shared decision making. This review emphasises the potential benefits of adding high quality observational studies in meta-analyses for the evaluation of objective outcome measures after surgical treatment.