Ultrasound assessment for grading structural tendon changes in supraspinatus tendinopathy: an inter-rater reliability study.
Ontology highlight
ABSTRACT:
SUBMITTER: Ingwersen KG
PROVIDER: S-EPMC4885468 | biostudies-other | 2016 May
REPOSITORIES: biostudies-other
Similar Datasets
Project description:ObjectivesThe reliability of ultrasonic strain elastography (SEL) used to detect abnormalities in the supraspinatus tendon is unclear. Thus, the aim of this study was to investigate the reliability of SEL in the supraspinatus tendon.DesignAn intra-rater and inter-rater reliability study.SettingA single-centre study conducted at the University of Southern Denmark.ParticipantsTwenty participants with shoulder pain and MRI-verified supraspinatus tendinosis and 20 asymptomatic participants (no MRI).Primary and secondary outcome measuresRaw values (RAW) and ratios (deltoid muscle (DELT) and gel pad (GEL) as reference tissues) were calculated and mean values of measurements from three regions of the supraspinatus tendon were reported. Colour scale ratings and number of yellow/red lesions from the three areas were also included.ResultsIntra-rater reliability showed intraclass correlation coefficients (ICCs) for RAW, DELT and GEL: 0.97 (minimal detectable change (MDC): 0.28 (6.36% of the mean)), 0.89 (MDC: 2.91 (20.37%)) and 0.73 (MDC: 1.61 (58.82%)), respectively. The ICCs for inter-rater reliability were 0.89 (MDC: 0.47 (10.53%)), 0.78 (MDC: 3.69 (25.51%)) and 0.70 (MDC: 1.75 (62.63%)), respectively.For colour scale ratings, intra-rater reliability (linear weighted kappa) ranged from 0.76 to 0.79, with the inter-rater reliability from 0.71 to 0.81. For the number of lesions, intra-rater reliability ranged from 0.40 to 0.82 and inter-rater reliability from 0.24 to 0.67.ConclusionsIntra-rater and inter-rater reliability were excellent for raw values and for ratios with deltoid muscle as the reference tissue, and good for ratios with gel pad as the reference tissue. The reliability of colour scale ratings was substantial-to-almost perfect, and for the number of lesions fair-to-almost perfect.Although high reliability was found, validity and responsiveness of these elastographic methods needs further investigation.Ethics approvalThe study protocol was approved by the Ethics Committee for the Region of South Denmark (S-20160115) and reported to the Danish Data Protection Agency (2014-41-3266).
| S-EPMC6527995 | biostudies-literature
Project description:ObjectivesTo determine the repeatability of corneal measurements from anterior segment optical coherence tomography (AS-OCT) images using ImageJ software in healthy eyes compared with eyes with keratoconus.MethodsAnterior segment OCT images of 25 eyes from 14 healthy subjects and 25 eyes from 15 subjects with keratoconus between the ages of 20 and 80 years were evaluated. Two trained observers used ImageJ to measure the central corneal cross-sectional area and anterior and posterior corneal arc lengths. MedCalc statistical software was used to generate the intraclass correlation coefficient (ICC) and Bland-Altman plots (BAPs) for observer measurements.ResultsObserver measurements of the central corneal cross-sectional area and anterior and posterior corneal arc lengths yielded an ICC >0.7. The ICC comparing the 3 parameters ranged from 0.75 to 0.84 for the control and 0.96 to 0.98 for the keratoconus group. No systematic proportional bias was detected by the BAPs. There were minimal differences between the 2 observer's measurements, with a mean of the difference of 0.3 mm2, 0 mm, and 0 mm, for the 3 measurements, respectively.ConclusionsThis study suggests that ImageJ software is a repeatable and reliable tool in the analysis of corneal parameters from AS-OCT images among patients with keratoconus and may be applicable to AS-OCT imaging protocol development, an area of active keratoconus research.
| S-EPMC8384674 | biostudies-literature
Project description:ObjectivesThe objectives of this study were to asses (1) inter-rater and intrarater reliability of ultrasound imaging in patients with hip osteoarthritis, and (2) agreement between ultrasound and X-ray findings of hip osteoarthritis using validated Outcome Measures in Rheumatology ultrasound definitions for pathology.DesignAn inter-rater and intrarater reliability study.SettingA single-centre study conducted at a regional hospital.Participants50 patients >39 years of age referred for radiography due to hip pain and suspected hip osteoarthritis were included. Exclusion criteria were previous hip surgery in the painful hip, suspected fracture or malignant changes in the hip.InterventionBilateral ultrasound examinations (n=92) were performed continuously by two experienced operators blinded to clinical information and other imaging findings. After 4-6 weeks, one operator reassessed the images. X-rays were assessed by a third imaging specialist.Primary and secondary outcome measuresInter-rater and intrarater reliability and agreement between ultrasound imaging and X-ray were assessed using Cohen's ordinal kappa statistics for binary categorical variables and weighted kappa for ordered categorical variables.ResultsKappa values (κ) for inter-rater reliability were 0.9 and 0.8 for hip effusion/synovitis and osteoarthritis grading, respectively. For acetabular and femoral osteophytes, femoral cartilage changes and labrum changes κ ranged from 0.4 to 0.7. Intrarater reliability had κ equal or higher compared with inter-rater reliability. Agreement between ultrasound and X-ray findings ranged from κ=0.2 to κ=0.5.ConclusionThis study demonstrated substantial to almost perfect reliability on the most common ultrasound findings related to hip osteoarthritis and osteoarthritis grading. Agreement on the grade of osteoarthritis between ultrasound and X-ray was moderate. Overall, these results support ultrasound imaging as a reliable tool in the assessment of hip osteoarthritis.
| S-EPMC7646344 | biostudies-literature
Project description:Introduction: To ensure the quality of clinical trial safety data, universal data standards are required. In 2019 the International Neonatal Consortium (INC) published a neonatal adverse event severity scale (NAESS) to standardize the reporting of adverse event (AE) severity. In this study the reliability of AE severity grading with INC NAESS was prospectively assessed in a real-world setting. Methods: Severity of AEs was assessed by two independent observers at each of four centers across the world. In each center two series of 30 neonatal adverse events were assessed by both observers: in a first phase with a generic (Common Terminology Criteria for Adverse Events, CTCAE) severity scale not specific to neonates, and in a second phase with INC NAESS (after a structured training). Intraclass correlation coefficients (ICC) were calculated to express inter-rater agreement in both phases, and bootstrap sampling was used to compare them. Results: 120 AEs were included in each of both phases. The ICC with the use of INC NAESS in phase 2 was 0.69. This represents a significant but modest improvement in comparison to the initial ICC of 0.66 in phase 1 (confidence interval of ratio of ICC in phase 2 to phase 1 = 1.005-1.146; excludes 1). The ICC was higher for those AEs for which a diagnosis specific AE severity table was available in INC NAESS (ICC 0.80). Discussion: Good inter-rater reliability of the INC NAESS was demonstrated in four neonatal intensive care units (NICUs) across the globe. The ICC is comparable to what is reported for scales with similar purposes in different populations. There is a modest, but significant, improvement in inter-rater agreement in comparison to the naïve phase without INC NAESS. The better performance when reviewers use AE-specific NAESS tables highlights the need to expand the number of AEs that are covered by specific criteria in the current version of INC NAESS.
| S-EPMC10512550 | biostudies-literature
Project description:AimTo develop and test a new adverse drug reaction (ADR) causality assessment tool (CAT).MethodsA comparison between seven assessors of a new CAT, formulated by an expert focus group, compared with the Naranjo CAT in 80 cases from a prospective observational study and 37 published ADR case reports (819 causality assessments in total).Main outcome measuresUtilisation of causality categories, measure of disagreements, inter-rater reliability (IRR).ResultsThe Liverpool ADR CAT, using 40 cases from an observational study, showed causality categories of 1 unlikely, 62 possible, 92 probable and 125 definite (1, 62, 92, 125) and 'moderate' IRR (kappa 0.48), compared to Naranjo (0, 100, 172, 8) with 'moderate' IRR (kappa 0.45). In a further 40 cases, the Liverpool tool (0, 66, 81, 133) showed 'good' IRR (kappa 0.6) while Naranjo (1, 90, 185, 4) remained 'moderate'.ConclusionThe Liverpool tool assigns the full range of causality categories and shows good IRR. Further assessment by different investigators in different settings is needed to fully assess the utility of this tool.
| S-EPMC3237416 | biostudies-literature
Project description:BACKGROUND:To analyse the reliability, variance and execution time of the Extended Timed Up and Go (Extended TUG) test in three age groups of elderly participants (G1: 55-64?years; G2: 65-74?years; G3: 75-85?years). METHODS:An analytical cross-sectional study of 114 recruited participants (63 women) of average age 70.17 (± 7.3) years was undertaken. Each participant performed the Extended TUG three consecutive times, with a rest break between tests of 120?s. Both the intragroup and intergroup reliability of the measurements in the Extended TUG were analysed. RESULTS:The reliability of the Extended TUG test is excellent for the first and second decades but drops down to good for the third decade. Specifically, intragroup reliability ranged from 0.784 for G3 to 0.977 for G1 (G2?=?0.858). Intergroup reliability, compared with intragroup reliability, was slightly lower, ranging between 0.779 for G3 and 0.972 for G1 (G2?=?0.853). CONCLUSION:The reliability of the Extended TUG test progressively decreases with increasing age, being excellent for the younger age groups and good for the oldest age group.
| S-EPMC7020600 | biostudies-literature
Project description:Near falls (NFs) are more frequent than falls, and may occur before falls, potentially predicting fall risk. As such, identification of a NF is important. We aimed to assess intra and inter-rater reliability of the traditional definition of a NF and to demonstrate the potential utility of a new definition. To this end, 10 older adults, 10 idiopathic elderly fallers, and 10 patients with Parkinson's disease (PD) walked in an obstacle course while wearing a safety harness. All walks were videotaped. Forty-nine video segments were extracted to create 2 clips each of 8.48 min. Four raters scored each event using the traditional definition and, two weeks later, using the new definition. A fifth rater used only the new definition. Intra-rater reliability was determined using Kappa (K) statistics and inter-rater reliability was determined using ICC. Using the traditional definition, three raters had poor intra-rater reliability (K<0.054, p>0.137) and one rater had moderate intra-rater reliability (K=0.624, p<0.001). With the traditional definition, inter-rater reliability between the four raters was moderate (ICC=0.667, p<0.001). In contrast, the new NF definition showed high intra-rater (K>0.601, p<0.001) and excellent inter-rater reliability (ICC=0.815, p<0.001). A priori, it is easy to distinguish falls from usual walking and NFs, but it is more challenging to distinguish NFs from obstacle negotiation and usual walking. Therefore, a more precise definition of NF is required. The results of the present study suggest that the proposed new definition increases intra and inter-rater reliability, a critical step for using NFs to quantify fall risk.
| S-EPMC3842362 | biostudies-literature
Project description:AimDespite the impact of spasticity, there is a lack of objective, clinically reliable and valid tools for its assessment. This study aims to evaluate the reliability of various performance- and spasticity-related parameters collected with a manually controlled instrumented spasticity assessment in four lower limb muscles in children with cerebral palsy (CP).MethodThe lateral gastrocnemius, medial hamstrings, rectus femoris and hip adductors of 12 children with spastic CP (12.8 years, ±4.13 years, bilateral/unilateral involvement n=7/5) were passively stretched in the sagittal plane at incremental velocities. Muscle activity, joint motion, and torque were synchronously recorded using electromyography, inertial sensors, and a force/torque load-cell. Reliability was assessed on three levels: (1) intra- and (2) inter-rater within session, and (3) intra-rater between session.ResultsParameters were found to be reliable in all three analyses, with 90% containing intra-class correlation coefficients >0.6, and 70% of standard error of measurement values <20% of the mean values. The most reliable analysis was intra-rater within session, followed by intra-rater between session, and then inter-rater within session. The Adds evaluation had a slightly lower level of reliability than that of the other muscles.ConclusionsLimited intrinsic/extrinsic errors were introduced by repeated stretch repetitions. The parameters were more reliable when the same rater, rather than different raters performed the evaluation. Standardisation and training should be further improved to reduce extrinsic error when different raters perform the measurement. Errors were also muscle specific, or related to the measurement set-up. They need to be accounted for, in particular when assessing pre-post interventions or longitudinal follow-up. The parameters of the instrumented spasticity assessment demonstrate a wide range of applications for both research and clinical environments in the quantification of spasticity.
| S-EPMC4489837 | biostudies-literature
Project description:PurposeTo assess inter-rater reliability in the detection of proliferative diabetic retinopathy (PDR) changes using wide-field optical coherence tomography angiography (WF-OCTA) versus fluorescein angiography (FA).MethodsThis retrospective, cross-sectional study included patients with severe nonproliferative and PDR. Images were acquired with 12 × 12 mm WF-OCTA and FA with a 55° lens. Images were cropped to represent the exact same field of view. Qualitative (detection of neovascularization at the disc [NVD] and elsewhere [NVE], enlarged foveal avascular zone [FAZ], vitreous hemorrhage [VH]) and quantitative analyses (FAZ area, horizontal, vertical, and maximum FAZ diameter) were performed by 2 masked graders using ImageJ. Inter-rater reliability was calculated using unweighted Cohen's kappa coefficient (κ) for qualitative analyses and intraclass correlation coefficients (ICC) for quantitative analyses.ResultsTwenty-three eyes of 17 patients were included. Inter-rater reliability was higher for FA than for WF-OCTA in qualitative analyses: κ values were 0.65 and 0.78 for detection of extended FAZ, 0.83 and 1.0 for NVD, 0.78 and 1.0 for NVE, and 0.19 and 1 for VH for WF-OCTA and FA, respectively. In contrast, inter-rater reliability was higher for WF-OCTA than for FA in the quantitative analyses: ICC values were 0.94 and 0.76 for FAZ size, 0.92 and 0.79 for horizontal FAZ diameter, 0.82 and 0.72 for vertical FAZ diameter, and 0.88 and 0.82 for maximum FAZ diameter on WF-OCTA and FA, respectively.ConclusionsInter-rater reliability of FA is superior to WF-OCTA for qualitative analyses whereas inter-rater reliability of WF-OCTA is superior to FA for quantitative analyses.Translational relevanceThe study highlights the specific merits of both imaging modalities in terms of reliability. FA should be preferred for qualitative parameters, whereas WF-OCTA should be preferred for quantitative parameters.
| S-EPMC10351024 | biostudies-literature
Project description:BackgroundFrailty assessment by paramedics in the prehospital setting is understudied. The goals of this study were to assess the inter-rater reliability and accuracy of frailty assessment by paramedics using the Clinical Frailty Scale (CFS).MethodsThis was a cross-sectional study with paramedics exposed to 30 clinical vignettes created from real-life situations. There was no teaching intervention prior to the study and paramedics were only provided with the French version of the CFS (definitions and pictograms). The primary outcome was the inter-rater reliability of the assessment. The secondary outcome was the accuracy, compared with the expert-based assessment. Reliability was determined by calculating an intraclass correlation coefficient (ICC). Accuracy was assessed through a mixed effects logistic regression model. A sensitivity analysis was carried out by considering that an assessment was still accurate if the score differed from no more than 1 level.ResultsA total of 56 paramedics completed the assessment. The overall assessment was found to have good inter-rater reliability (ICC = 0.87 [95%CI 0.81-0.93]). The overall accuracy was moderate at 60.6% (95%CI 54.9-66.1) when considering the full scale. It was however much higher (94.8% [95%CI 92.0-96.7] when close assessments were considered as accurate. The only factor associated with accurate assessment was field experience.ConclusionThe assessment of frailty by paramedics was reliable in this vignette-based study. However, the accuracy deserved to be improved. Future research should focus on the clinical impact of these results and on the association of prehospital frailty assessment with patient outcomes.RegistrationThis study was registered on the Open Science Framework registries ( https://doi.org/10.17605/OSF.IO/VDUZY ).
| S-EPMC10576312 | biostudies-literature