Dataset Information

Intrarater and interrater reliability of three classifications for scapular dyskinesis in athletes.

ABSTRACT: Clinical evaluation of scapular dyskinesis (SD) aims to identify abnormal scapulothoracic movement, underlying causal factors, and the potential relationship with shoulder symptoms. The literature proposes different methods of dynamic clinical evaluation of SD, but improved reliability and agreement values are needed. The present study aimed to evaluate the intrarater and interrater agreement and reliability of three SD classifications: 1) 4-type classification, 2) Yes/No classification, and 3) scapular dyskinesis test (SDT). Seventy-five young athletes, including 45 men and 30 women, were evaluated. Raters evaluated the SD based on the three methods during one series of 8-10 cycles (at least eight and maximum of ten) of forward flexion and abduction with an external load under the observation of two raters trained to diagnose SD. The evaluation protocol was repeated after 3 h for intrarater analysis. The agreement percentage was calculated by dividing the observed agreement by the total number of observations. Reliability was calculated using Cohen Kappa coefficient, with a 95% confidence interval (CI), defined by Kappa coefficient ±1.96 multiplied by the measurement standard error. The interrater analyses showed an agreement percentage between 80% and 95.9% and an almost perfect reliability (k>0.81) for the three classification methods in all the test conditions, except the 4-type and SDT classification methods, which had substantial reliability (k<0.80) in shoulder abduction. Intrarater analyses showed agreement percentages between 80.7% and 89.3% and substantial reliability (0.67 to 0.81) for both raters in the three classifications. CIs ranged from moderate to almost perfect categories. This indicates that the three SD classification methods investigated in this study showed high reliability values for both intrarater and interrater evaluation throughout a protocol that provided SD evaluation training of raters and included several repetitions of arm movements with external load during a live assessment.

SUBMITTER: Rossi DM

PROVIDER: S-EPMC5531566 | biostudies-literature | 2017

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Intrarater and interrater reliability of three classifications for scapular dyskinesis in athletes.

Rossi Denise Martineli DM Pedroni Cristiane Rodrigues CR Martins Jaqueline J de Oliveira Anamaria Siriani AS

PloS one 20170727 7

Clinical evaluation of scapular dyskinesis (SD) aims to identify abnormal scapulothoracic movement, underlying causal factors, and the potential relationship with shoulder symptoms. The literature proposes different methods of dynamic clinical evaluation of SD, but improved reliability and agreement values are needed. The present study aimed to evaluate the intrarater and interrater agreement and reliability of three SD classifications: 1) 4-type classification, 2) Yes/No classification, and 3) ...[more]

PMID: 28749966

Similar Datasets

Project description:PURPOSE:Many neonates undergo electroencephalogram (EEG) monitoring to identify and manage acute symptomatic seizures. Information about brain function contained in the EEG background data may also help predict neurobehavioral outcomes. For EEG background features to be useful as prognostic indicators, the interpretation of these features must be standardized across electroencephalographers. We aimed at determining the interrater and intrarater agreement among electroencephalographers interpreting neonatal EEG background patterns. METHODS:Five neonatal electroencephalographers reviewed 5-to-7.5-minute epochs of EEG from full-term neonates who underwent continuous conventional EEG monitoring. The EEG assessment tool used to classify background patterns was based on the American Clinical Neurophysiology Society's guideline for neonatal EEG terminology. Interrater and intrarater agreement were measured using Kappa coefficients. RESULTS:Interrater agreement was consistently highest for voltage (binary: substantial, kappa = 0.783; categorical: moderate, kappa = 0.562), seizure presence (fair-substantial; kappa = 0.375-0.697), continuity (moderate; kappa = 0.481), burst voltage (moderate; kappa = 0.574), suppressed background presence (moderate-substantial; kappa = 0.493-0.643), delta activity presence (fair-moderate; kappa = 0.369-0.432), theta activity presence (fair-moderate; kappa = 0.347-0.600), presence of graphoelements (fair; kappa = 0.381), and overall impression (binary: moderate, kappa = 0.495; categorical: fair-moderate, kappa = 0.347, 0.465). Agreement was poor or inconsistent for all other patterns. Intrarater agreement was variable, with highest average agreement for voltage (binary: substantial, kappa = 0.75; categorical: substantial, kappa = 0.714) and highest consistent agreement for continuity (moderate-substantial; kappa = 0.43-0.67) and overall impression (moderate-substantial; kappa = 0.42-0.68). CONCLUSIONS:This study demonstrates substantial variability in neonatal EEG background interpretation across electroencephalographers, indicating a need for educational and technological strategies aimed at improving performance.

Project description:BACKGROUND:Scapular dyskinesis is an alteration in normal scapular position and motion. Some researchers believe that altered kinematics of the scapula subsequent to dysfunction or weakness of scapular stabilizing muscles contributes to impingement syndrome. Scapular muscle exercises are included in the rehabilitation of patients with subacromial impingement syndrome and scapular dyskinesis because the muscular system is one of the major contributors of scapular positioning both at rest and during shoulder movement, but there is considerable uncertainty relating to the relative effectiveness of such approaches on changing scapular position and motion. OBJECTIVE:The aim of this systematic review protocol is to evaluate the effectiveness of exercise therapy on scapular position and motion in individuals with scapular dyskinesis. METHODS:A systematic review will be conducted using PubMed, Scopus, Web of Science, Elsevier, Ovid, ProQuest, Physiotherapy Evidence Database, and Cochrane Library. The reference lists of articles, other reviews, gray literature, and key journals will be searched for relevant articles. Clinical trials reporting the effect of therapeutic exercises (scapular strengthening exercise, scapular stabilization exercise, scapular muscle stretching) with the aims of changing scapular position and motion in individuals with scapular dyskinesis will be included. Two independent reviewers will select studies, extract data, and assess the quality of primary studies. Any disagreement during the selection of studies will be discussed and decided by the whole team. RESULTS:This systematic review began in December 2016 and is currently in progress. The findings will be synthesized to determine the effectiveness of recommended therapeutic exercise on scapular position and motion in individuals with scapular dyskinesis. CONCLUSIONS:This is the first systematic review protocol aiming to assess the effectiveness of exercise therapy in individuals with scapular dyskinesis. The systematic review doesn't require ethics approval because all data used will be provided from published documents. The results of this study will be published in a peer-reviewed journal. TRIAL REGISTRATION:PROSPERO CRD42017053923; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=53923 (Archived by WebCite at http://www.webcitation.org/6uzq32T02).

Project description:Background: Push-up (PU) is widely considered an effective exercise to stabilize the scapular, especially if performed on unstable surfaces. However, available studies cover a wide range of exercise variations and differ according to exercise prescription, muscle selection and study design. Therefore, findings are contradictory, and conclusions for a proper application of the PU are difficult to draw. Objective: To synthesize the available literature on the changes in the activity of the periscapular muscles in individuals without scapular dyskinesis while performing different types of PU on unstable surfaces. Search procedure: Four online databases were searched from the earliest publications to 9 August 2023, using predefined keywords. Out of the 2,850 potential references identified in the primary search, 92 studies were reviewed in detail, of which 38 met the inclusion criteria and were included. Methodological quality was evaluated using a standardized form based on the Newcastle‒Ottawa scale for observational studies. Data combination was performed using CMA (v3), and the random-effects model was used to calculate the standardized mean difference (SMD) with a 95% confidence interval (CI). Results: The use of unstable surfaces in people without scapular dyskinesis led to increased activity of the upper trapezius during the PU (p = 0.017; I2 = 84.95%; SMD = 0.425 [95% CI 0.077, 0.773]) and knee PU (p = 0.023; I2 = 70.23%; SMD = 0.474 [95% CI 0.066, 0.882]) exercises and increased activity of the middle trapezius (MT) (p = 0.003; I2 = 64.50%; SMD = 0.672 [95% CI 0.225, 1.119]) and serratus anterior (SA) (p = 0.039; I2 = 4.25%; SMD = 0.216 [95% CI 0.011, 0.420]) muscles during the push-up plus (PUP) exercise. Conclusion: Using an unstable support base during PU does not necessarily increase the activity of all scapular stabilizers. The amount of muscle activity depends on the type of PU other than the type of support base. If an unstable surface is used, PUP exercise appears to be the most effective modality to increase the quality of training, improve performance, and prevent the occurrence of scapular dyskinesis due to the increase in the activity of the MT and SA muscles. Systematic Review Registration: http://www.crd.york.ac.uk/PROSPERO, CRD42021268465.

Project description:ObjectivesSpinal accessory nerve dysfunction is one of the complications of neck dissection in patients with oral cancer. This study aimed to explore the effects of long-term scapular-focused exercises and conscious control of scapular orientation on scapular movement and quality of life (QoL).MethodsThis study was a randomized controlled trial with concealed allocation, assessor blinding, and intention-to-treat analysis. Thirty-six patients with oral cancer were randomly allocated to the motor-control group (scapular-focused exercise + conscious control of scapular orientation) or the regular-exercise group (scapular-focused exercises only). Both groups received conventional physical therapy after neck dissection for 3 months. Shoulder pain intensity, active range of motion (AROM) of shoulder abduction, scapular muscle strength and activity under maximal voluntary isometric contraction (MVIC), scapular muscle activity when performing scapular movements, and QoL were measured at baseline, 1 month after the start of the intervention, and the end of the intervention.ResultsBoth groups showed significant improvement in all outcomes except shoulder pain intensity. After the 3-month intervention, the motor-control group had more significant improvement in AROM of shoulder abduction with a 19° difference (95% CI: 10-29, P < .001), muscle strength of upper trapezius with an 11 N difference (95% CI: 2-20; P = .021), and QoL than the regular-exercise group. When performing shoulder horizontal adduction and flexion, the relative value (%MVIC) of serratus anterior was smaller in the motor-control group with a 106%MVIC difference (95% CI: 7-205, P = .037).ConclusionsScapular-focused exercises have promising effects on spinal accessory nerve dysfunction. Combining scapular-focused exercises with conscious control of scapular orientation has more remarkable benefits on AROM of shoulder abduction, UT muscle strength, and muscle activation pattern than the scapular-focused exercises alone. Conscious control of scapular orientation should be considered to integrate into scapular-focused exercises in patients with oral cancer and scapular dyskinesis.Trial registry name and URL, and registration number: ClinicalTrials.gov (URL: https://clinicaltrials.gov; Approval No: NCT03545100).

Project description:BackgroundInterrater reliability, aka intercoder reliability, is defined as true agreement between raters, aka coders, without chance agreement. It is used across many disciplines including medical and health research to measure the quality of ratings, coding, diagnoses, or other observations and judgements. While numerous indices of interrater reliability are available, experts disagree on which ones are legitimate or more appropriate. Almost all agree that percent agreement (ao), the oldest and the simplest index, is also the most flawed because it fails to estimate and remove chance agreement, which is produced by raters' random rating. The experts, however, disagree on which chance estimators are legitimate or better. The experts also disagree on which of the three factors, rating category, distribution skew, or task difficulty, an index should rely on to estimate chance agreement, or which factors the known indices in fact rely on. The most popular chance-adjusted indices, according to a functionalist view of mathematical statistics, assume that all raters conduct intentional and maximum random rating while typical raters conduct involuntary and reluctant random rating. The mismatches between the assumed and the actual rater behaviors cause the indices to rely on mistaken factors to estimate chance agreement, leading to the numerous paradoxes, abnormalities, and other misbehaviors of the indices identified by prior studies.MethodsWe conducted a 4 × 8 × 3 between-subject controlled experiment with 4 subjects per cell. Each subject was a rating session with 100 pairs of rating by two raters, totaling 384 rating sessions as the experimental subjects. The experiment tested seven best-known indices of interrater reliability against the observed reliabilities and chance agreements. Impacts of the three factors, i.e., rating category, distribution skew, and task difficulty, on the indices were tested.ResultsThe most criticized index, percent agreement (ao), showed as the most accurate predictor of reliability, reporting directional r2 = .84. It was also the third best approximator, overestimating observed reliability by 13 percentage points on average. The three most acclaimed and most popular indices, Scott's π, Cohen's κ and Krippendorff's α, underperformed all other indices, reporting directional r2 = .312 and underestimated reliability by 31.4 ~ 31.8 points. The newest index, Gwet's AC1, emerged as the second-best predictor and the most accurate approximator. Bennett et al's S ranked behind AC1, and Perreault and Leigh's Ir ranked the fourth both for prediction and approximation. The reliance on category and skew and failure to rely on difficulty explain why the six chance-adjusted indices often underperformed ao, which they were created to outperform. The evidence corroborated the notion that the chance-adjusted indices assume intentional and maximum random rating while the raters instead exhibited involuntary and reluctant random rating.ConclusionThe authors call for more empirical studies and especially more controlled experiments to falsify or qualify this study. If the main findings are replicated and the underlying theories supported, new thinking and new indices may be needed. Index designers may need to refrain from assuming intentional and maximum random rating, and instead assume involuntary and reluctant random rating. Accordingly, the new indices may need to rely on task difficulty, rather than distribution skew or rating category, to estimate chance agreement.

Dataset Information

Intrarater and interrater reliability of three classifications for scapular dyskinesis in athletes.

Publications

Intrarater and interrater reliability of three classifications for scapular dyskinesis in athletes.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets