Dataset Information

Inter-Rater Reliability of the Modified Radiographic Union Score for Diaphyseal Tibial Fractures With Bone Defects.

ABSTRACT: OBJECTIVES:To evaluate inter-rater reliability of the modified Radiographic Union Score for Tibial (mRUST) fractures among patients with open, diaphyseal tibia fractures with a bone defect treated with intramedullary nails (IMNs), plates, or definitive external fixation (ex-fix). DESIGN:Retrospective cohort study. SETTING:Fifteen-level one civilian trauma centers; 2 military treatment facilities. PATIENTS/PARTICIPANTS:Patients ?18 years old with open, diaphyseal tibia fractures with a bone defect ?1 cm surgically treated between 2007 and 2012. INTERVENTION:Three of 6 orthopedic traumatologists reviewed and applied mRUST scoring criteria to radiographs from the last clinical visit within 13 months of injury. MAIN OUTCOME MEASUREMENTS:Inter-rater reliability was assessed using Krippendorff's alpha (KA) statistic; intraclass correlation coefficient (ICC) is presented for comparison with previous publications. RESULTS:Two hundred thirteen patients met inclusion criteria including 115 IMNs, 24 plates, 29 ex-fixes, and 45 cases that no longer had instrumentation at evaluation. All reviewers agreed on the pattern of scoreable cortices for 90.4% of IMNs, 88.9% of those without instrumentation, 44.8% of rings, and 20.8% of plates. Thirty-one (15%) cases, primarily plates and ex-fixes, did not contribute to KA and ICC estimates because <2 raters scored all cortices. The overall KA for the 85% that could be analyzed was 0.64 (ICC 0.71). For IMNs, plates, ex-fixes, and no instrumentation, KA (ICC) was 0.65 (0.75), 0.88 (0.90), 0.47 (0.62), and 0.48 (0.57), respectively. CONCLUSIONS:In tibia fractures with bone defects, the mRUST seems similarly reliable to previous work in patients treated with IMN but is less reliable in those with plates or ex-fixes, or after removal of instrumentation.

SUBMITTER: Mitchell SL

PROVIDER: S-EPMC6534445 | biostudies-literature | 2019 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Inter-Rater Reliability of the Modified Radiographic Union Score for Diaphyseal Tibial Fractures With Bone Defects.

Mitchell Stuart L SL Obremskey William T WT Luly Jason J Bosse Michael J MJ Frey Katherine P KP Hsu Joseph R JR MacKenzie Ellen J EJ Morshed Saam S OʼToole Robert V RV Scharfstein Daniel O DO Tornetta Paul P

Journal of orthopaedic trauma 20190601 6

<h4>Objectives</h4>To evaluate inter-rater reliability of the modified Radiographic Union Score for Tibial (mRUST) fractures among patients with open, diaphyseal tibia fractures with a bone defect treated with intramedullary nails (IMNs), plates, or definitive external fixation (ex-fix).<h4>Design</h4>Retrospective cohort study.<h4>Setting</h4>Fifteen-level one civilian trauma centers; 2 military treatment facilities.<h4>Patients/participants</h4>Patients ≥18 years old with open, diaphyseal tibi ...[more]

PMID: 30741726

Similar Datasets

Project description:The Radiographic Union Score for Hip (RUSH) is a previously validated outcome instrument designed to improve intra- and interobserver reliability when describing the radiographic healing of femoral neck fractures. The ability to identify fractures that have not healed is important for defining nonunion in clinical trials and predicting patients who will likely require additional surgery to promote fracture healing. We sought to investigate the utility of the RUSH score to define femoral neck fracture nonunion.(1) What RUSH score threshold yields at least 98% specificity to diagnose nonunion at 6 months postinjury? (2) Using the threshold identified, are patients below this threshold at greater risk of reoperation for nonunion and for other indications?A representative sample of 250 out of a cohort of 725 patients with adequate 6-month hip radiographs was analyzed from a multinational elderly hip fracture trial (FAITH). All patients had a femoral neck fracture and were treated with either multiple cancellous screws or a sliding hip screw. Two reviewers independently determined the RUSH score based on the 6-month postinjury radiographs and interrater reliability was assessed with the interclass correlation coefficient (ICC). There was substantial reliability between the reviewers assigning the RUSH scores (ICC, 0.81; 95% confidence interval [CI], 0.76-0.85). The RUSH score is a checklist-based system that quantifies four measures of healing: cortical bridging, cortical fracture disappearance, trabecular consolidation, and trabecular fracture disappearance.. Fracture healing was determined by two independent methods: (1) concurrently by the treating surgeon using both clinical and radiographic assessments as per routine clinical care; and (2) retrospectively by a Central Adjudication Committee using complete obliteration of the fracture line on radiographs alone. Receiver operating characteristic tables were used to define a RUSH threshold score that was > 98% specific for fracture nonunion.A threshold score of < 18 was associated with a 100% specificity (95% CI, 97%-100%) and a positive predictive value of 100% (95% CI, 73%-100%) for radiographic nonunion. In contrast, using the fracture healing assessments of the treating surgeons failed to identify a useful discriminatory nonunion threshold and the highest positive predictive value was 43%. With respect to complications, patients with RUSH scores below 18 had greater risk of undergoing reoperation for nonunion (reoperation when < 18: six of 13 [46%]; reoperation when ? 18: 11 of 237 [54%]; relative risk [RR], 9.9 [95% CI, 4.4-22.7]; p < 0.001) and for all indications (reoperation when < 18: eight of 13 [62%]; reoperation when ? 18: 54 of 237 [38%]; RR, 2.7 [95% CI, 1.7-4.4]; p = 0.004).The 6-month RUSH score is a reliable method for assessing radiographic healing. Our results highlight the discordance between radiographic determinations and clinician assessments of fracture healing and stress the need for clinical data to be incorporated in research studies evaluating fracture healing.Level III, diagnostic study.

Project description:ObjectivesTo investigate the intra- and inter-rater reliability of the total radiomics quality score (RQS) and the reproducibility of individual RQS items' score in a large multireader study.MethodsNine raters with different backgrounds were randomly assigned to three groups based on their proficiency with RQS utilization: Groups 1 and 2 represented the inter-rater reliability groups with or without prior training in RQS, respectively; group 3 represented the intra-rater reliability group. Thirty-three original research papers on radiomics were evaluated by raters of groups 1 and 2. Of the 33 papers, 17 were evaluated twice with an interval of 1 month by raters of group 3. Intraclass coefficient (ICC) for continuous variables, and Fleiss' and Cohen's kappa (k) statistics for categorical variables were used.ResultsThe inter-rater reliability was poor to moderate for total RQS (ICC 0.30-055, p < 0.001) and very low to good for item's reproducibility (k - 0.12 to 0.75) within groups 1 and 2 for both inexperienced and experienced raters. The intra-rater reliability for total RQS was moderate for the less experienced rater (ICC 0.522, p = 0.009), whereas experienced raters showed excellent intra-rater reliability (ICC 0.91-0.99, p < 0.001) between the first and second read. Intra-rater reliability on RQS items' score reproducibility was higher and most of the items had moderate to good intra-rater reliability (k - 0.40 to 1).ConclusionsReproducibility of the total RQS and the score of individual RQS items is low. There is a need for a robust and reproducible assessment method to assess the quality of radiomics research.Clinical relevance statementThere is a need for reproducible scoring systems to improve quality of radiomics research and consecutively close the translational gap between research and clinical implementation.Key points• Radiomics quality score has been widely used for the evaluation of radiomics studies. • Although the intra-rater reliability was moderate to excellent, intra- and inter-rater reliability of total score and point-by-point scores were low with radiomics quality score. • A robust, easy-to-use scoring system is needed for the evaluation of radiomics research.

Project description:BackgroundOrthopedic surgeons use radiographs to determine degrees of fracture healing, guide progression of clinical care, and assist in determining weight bearing and removal of immobilization. However, no gold standard exists to determine the progression of healing of humeral shaft fractures treated non-operatively.PurposeThe purpose of this study was to determine whether a scale comparable to the modified Radiographic Union Score for Tibial (RUST) fractures applied to non-operatively treated humeral shaft fractures can increase interobserver reliability in determining fracture healing.MethodsA retrospective review was undertaken by three orthopedic traumatologists and one musculoskeletal radiologist, who evaluated 50 sets of anteroposterior and lateral radiographs, presented at random, of non-operatively treated humeral shaft fractures at various stages of healing from 17 patients. The radiographs were scored using a modified RUST scale called the Radiographic Humerus Union Measurement (RHUM). Observers were blinded to the time from injury. After a 4-week washout period, observers again scored the same radiographs. Observers classified each fracture as either healed or not healed based on the combination of radiographs. Inter- and intraobserver reliability of the RHUM were determined using an intraclass correlation coefficient (ICC). Interobserver reliability of determining a healed fracture was calculated using Cohen's kappa (κ) statistics. A receiver operator characteristic curve was conducted to determine the RHUM score predictive of a fracture being considered healed.ResultsICC demonstrated almost perfect interobserver reliability (ICC, 0.838; ICC 95% CI, 0.765 to 0.896) and intraobserver reliability (ICC range, 0.822 to 0.948) of the RHUM. κ demonstrated substantial agreement between observers in considering a fracture healed (κ = 0.647). Receiver operating characteristic (ROC) curve demonstrated that a RHUM of 10 or higher is an excellent predictor of the observer considering the fracture healed (area under the ROC curve = 0.946, specificity = 0.957, 95% CI specificity, 0.916 to 0.979).ConclusionsThis cortical scoring system has excellent interobserver reliability in humeral shaft fractures treated non-operatively. Consistent with previous cortical scoring systems, a RHUM score of 10 or above can be considered radiographically healed.

Dataset Information

Inter-Rater Reliability of the Modified Radiographic Union Score for Diaphyseal Tibial Fractures With Bone Defects.

Publications

Inter-Rater Reliability of the Modified Radiographic Union Score for Diaphyseal Tibial Fractures With Bone Defects.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets