Dataset Information

How are risk ratios reported in orthopaedic surgery journals? A descriptive study of formats used to report absolute risks.

ABSTRACT:

Purpose

The numerical format in which risks are communicated can affect risk comprehension and perceptions of medical professionals. We investigated what numerical formats are used to report absolute risks in empirical articles, estimated the frequency of biasing formats and rated the quality of figures used to display the risks.

Design

Descriptive study of reporting practices.

Method

We randomly sampled articles published in seven leading orthopaedic surgery journals during a period of 13 years. From these, we selected articles that reported group comparisons on a binary outcome (eg, revision rates in two groups) and recorded the numerical format used to communicate the absolute risks in the results section. The quality of figures was assessed according to published guidelines for transparent visual aids design.

Outcome measures

Prevalence of information formats and quality of figures.

Results

The final sample consisted of 507 articles, of which 14% reported level 1 evidence, 13% level 2 and 73% level 3 or lower. The majority of articles compared groups of different sizes (90%), reported both raw numbers and percentages (64%) and did not report the group sizes alongside (50%). Fifteen per cent of articles used two formats identified as biasing: only raw numbers (8%, '90 patients vs 100 patients') or raw numbers reported alongside different group sizes (7%, '90 out of 340 patients vs 100 out of 490 patients'). The prevalence of these formats decreased in more recent publications. Figures (n=79) had on average two faults that could distort comprehension, and the majority were rated as biasing.

Conclusion

Authors use a variety of formats to report absolute risks in scientific articles and are likely not aware of how some formats and graph design features can distort comprehension. Biases can be reduced if journals adopt guidelines for transparent risk communication but more research is needed into the effects of different formats.

SUBMITTER: Petrova D

PROVIDER: S-EPMC6254491 | biostudies-literature | 2018 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

How are risk ratios reported in orthopaedic surgery journals? A descriptive study of formats used to report absolute risks.

Petrova Dafina D Joeris Alexander A Sánchez María-José MJ Salamanca-Fernández Elena E Garcia-Retamero Rocio R

BMJ open 20181125 11

<h4>Purpose</h4>The numerical format in which risks are communicated can affect risk comprehension and perceptions of medical professionals. We investigated what numerical formats are used to report absolute risks in empirical articles, estimated the frequency of biasing formats and rated the quality of figures used to display the risks.<h4>Design</h4>Descriptive study of reporting practices.<h4>Method</h4>We randomly sampled articles published in seven leading orthopaedic surgery journals durin ...[more]

PMID: 30478128

Similar Datasets

Project description:Objectives. High opioid prescription rates in the United States and Europe suggest miscalibrated risk perceptions among those who prescribe, dispense, and take opioids. Findings from cognitive decision science suggest that risk perceptions and behaviors can differ depending on whether people learn about risks by experience or description. This study investigated effects of a descriptive versus an experience-based risk education format on pharmacists' risk perceptions and counseling behavior in the long-term administration of strong opioids to patients with chronic noncancer pain. Methods. In an exploratory, randomized controlled online trial, 300 German pharmacists were randomly assigned to either a descriptive format (fact box) or a simulated experience format (interactive simulation). Primary Outcome Measures. 1) Objective risk perception, 2) subjective risk perception, and 3) intended and 4) actual counseling behavior. Results. Both risk formats significantly improved pharmacists' objective risk perception, but pharmacists exposed to the fact box estimated the benefit-harm ratio more accurately than those exposed to the simulation. Both formats proved equally effective in adjusting pharmacists' subjective risk perception toward a better recognition of opioids' harms; however, pharmacists receiving the simulation showed a greater change in their actual counseling behavior and higher consistency between their intended and actual counseling than pharmacists receiving the fact box. Conclusion. The simulated experience format was less effective than the descriptive format in improving pharmacists' objective risk perception, equally effective in motivating pharmacists to counsel patients on less risky treatment alternatives and more effective in changing the reported actual counseling behavior. Implications. These exploratory findings provide important insights into the relevance of the description-experience gap for drug safety and raise questions for future research regarding the specific mechanisms at work.

Project description:PurposeOutcomes of randomized controlled trials (RCTs) have been shown to influence clinical decision making. Thus, the quality and reliability of these outcomes are essential for both patients and medical care providers. To date, no study has assessed the quality of intervention reporting of RCTs in orthopaedics. The aim of this study was to evaluate the quality of intervention reporting of published RCTs in the field of orthopaedics using the Template for Intervention Description and Replication (TIDieR) checklist.MethodsIn this cross-sectional analysis, we applied the TIDieR checklist to assess the quality of intervention reporting in orthopaedic RCTs. Additionally, we evaluated the TIDieR checklist's influence on intervention reporting by comparing overall adherence to checklist items in trials published before the TIDieR checklist's release versus trials published after its release. Finally, we assessed whether certain factors were associated with the quality of intervention reporting.ResultsFrom a random sample of 300 publications in orthopaedic journals, 175 parallel-arm and cluster RCTs were identified. The overall rate of adherence to TIDieR items was 58.4%. Only 31.4% of orthopaedic RCTs adhered to at least 6 of the 12 TIDieR checklist items, whereas 0% adhered to all 12 items. We found no significant improvement in the quality of intervention reporting in studies published after the TIDieR checklist's release compared with studies published before its release (P = .97). Additionally, preregistered trials were associated with more complete intervention reporting.ConclusionsOur results suggest suboptimal reporting of orthopaedic RCT interventions. In addition, the TIDieR checklist's intended effect-to better the quality of RCT intervention reporting-appears to have fallen short of its goal.Clinical relevanceBecause outcomes of RCTs are used to guide clinical decision making, it is essential that orthopaedic surgeons and clinical practice guideline panels are equipped with high-quality published research. Increasing the accuracy of intervention reporting may lead to more accurate clinical application. Thus, adoption of more stringent reporting of trial interventions by researchers, authors, and journal editors may improve the quality of orthopaedic research, as well as improve patient outcomes.

Project description:BackgroundRandomized controlled trials (RCTs) are crucial in comparative research, and a careful approach to randomization methodology helps minimize bias. However, confounding variables like socioeconomic status (SES) and race are often underreported in orthopaedic RCTs, potentially affecting the generalizability of results. This study aimed to analyze the reporting trends of SES and race in RCTs pertaining to Achilles tendon pathology, considering 4 decades of data from top-tier orthopaedic journals.MethodsThis review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines and used PubMed to search 10 high-impact factor orthopaedic journals for RCTs related to the management of Achilles tendon pathology. The search encompassed all articles from the inception of each journal until July 11, 2023. Data extraction included year of publication, study type, reporting of SES and race, primary study location, and intervention details.ResultsOf the 88 RCTs identified, 68 met the inclusion criteria. Based on decade of publication, 6 articles (8.8%) reported on SES, whereas only 2 articles (2.9%) reported on race. No RCTs reported SES in the pre-1999 period, but the frequency of reporting increased in subsequent decades. Meanwhile, all RCTs reporting race were published in the current decade (2020-2030), with a frequency of 20%. When considering the study location, RCTs conducted outside the United States were more likely to report SES compared with those within the USA.ConclusionThis review revealed a concerning underreporting of SES and race in Achilles tendon pathology RCTs. The reporting percentage remains low for both SES and race, indicating a need for comprehensive reporting practices in orthopaedic research. Understanding the impact of SES and race on treatment outcomes is critical for informed clinical decision making and ensuring equitable patient care. Future studies should prioritize the inclusion of these variables to enhance the generalizability and validity of RCT results.

Project description:Previous studies have shown that patients' anxiety and dissatisfaction are predictors for increased postoperative pain and reduced efficacy of pain treatment. However, it remains to be shown whether patient anxiety and concern are predictors for the perceived quality of treatment and patient reported outcome (PRO).The aim of this study is to investigate whether there is a correlation between preoperative anxiety and concern, and the perceived quality of postoperative treatment and outcome. The hypothesis is that anxious and concerned patients are less satisfied with treatment and have a poorer outcome.This study is designed as a prospective follow-up study and has the aim of investigating the correlation between patient anxiety and concern, patients' perceived quality of treatment and outcome. This correlation will be detected using five questionnaires: CMD-SQ (Common Mental Disorders Screening Questionnaire), EuroQol 5 Dimensions (EQ-5D), Short form 12 (SF-12), "What is your evaluation of the patient progress in the Department of Orthopaedic Surgery?" (HVOK), Questionnaire for patients who have had hip surgery (RCS) and Oxford Hip Score (OHS) or Oxford Shoulder Score (OSS). The patients will complete the above mentioned questionnaires preoperatively in the outpatient department, and postoperatively just before discharge from the inpatient department, and 12 and 52 weeks after the operation. The study includes a reliability test of CMD-SQ regarding this specific population and tested by means of a Kappa. A total of 500 hip- and shoulder-patients will be included from October 2010 till October 2011.If a correlation between patient anxiety and concern, patients' perceived quality of treatment and patient reported outcome is found, it will be recommended to screen all hip- and shoulder-patients for anxiety and concern preoperatively. Besides, it would be relevant to carry out investigations of possible interventions towards anxious and concerned patients.Current Controlled Trials: NCT01205295.

Project description:PurposeTo determine how well the orthopaedic sports medicine literature reported sex-specific analysis (SSA) in 2011 and 2016.MethodsThe 3 highest-impact orthopaedic sports medicine subspecialty journals (American Journal of Sports Medicine; Arthroscopy; and Knee Surgery, Sports Traumatology, Arthroscopy) were selected for review. Two independent investigators reviewed all journal issues published during 2 different calendar years (2011 and 2016). All randomized controlled, prospective and retrospective group, and case-control studies were included. Studies were stratified into those that involved SSA, where sex was a variable in a multifactorial statistical model, and those that only reported sex as a demographic characteristic or used sex-matched groups without further analysis.ResultsA total of 960 studies evaluating 3,400,569 patients met criteria and were included in this review. Although 44.4% of the overall study population was female, only 293 (30.5%) studies included patient sex as variable in a multifactorial statistical model. The proportion of studies that performed SSA did not differ between 2011 (29.6%) and 2016 (31.1%; P = .607), although publications from American Journal of Sports Medicine were likely to report SSA (P < .05). Of the 293 studies that reported SSA, 91 (31%) demonstrated a significant difference in outcomes. The most commonly reported differences were in outcomes following anterior cruciate ligament, medial patellofemoral ligament, and posterior cruciate ligament reconstruction; autograft preparation; postoperative use of opiates following arthroscopy; and recovery after sports-related concussions.ConclusionsAlthough most sports medicine studies include approximately 50% female and 50% male patients, statistical analysis differentiating the 2 subsets is not routinely performed. Only 30.5% of all studies performed SSA, 31% of which reported a statistically significant difference in the data when comparing outcomes between male and female patients with the same treatment modalities.Clinical relevanceThe current study demonstrates that the orthopaedic sports medicine subspecialty literature is lacking in reporting SSA, and that there has been minimal improvement over a 5-year time period. In addition, this study highlights the high percentage of significant findings within the studies that performed SSA and underscores the differences in sex-specific injury patterns and treatment outcomes.

Dataset Information

How are risk ratios reported in orthopaedic surgery journals? A descriptive study of formats used to report absolute risks.

Purpose

Design

Method

Outcome measures

Results

Conclusion

Publications

How are risk ratios reported in orthopaedic surgery journals? A descriptive study of formats used to report absolute risks.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets