Inter-rater Reliability of the McKenzie Method of Mechanical Diagnosis and Therapy for the Provisional Classification of Low Back Pain in Adolescents and Young Adults.
Ontology highlight
ABSTRACT: Objective
To investigate the inter-rater reliability of Mechanical Diagnosis and Therapy (MDT)-trained Diplomats in classifying adolescents and young adults with lumbar pain.Methods
Forty-three participants (mean age 15 ± 2 years) with lumbar pain, with or without lower extremity symptoms, were assessed simultaneously by three MDT Diploma holders and classified into one of three groups: 1) Derangement, 2) Dysfunction, 3) Postural/OTHER. Inter-rater reliability was calculated using the Fleiss kappa statistics with 95% confidence intervals (CI). Analyses were repeated with the younger (11 to 15 years old) and older (16 to 21 years old) age groups.Results
There was moderate reliability (Fleiss kappa = 0.50, 95% CI = 0.45 to 0.54) for the entire sample, which was statistically significant (p < 0.001). There was good reliability in older participants (Fleiss kappa = 0.63, 95% CI = 0.57 to 0.70), but poor reliability in younger participants (Fleiss kappa = 0.33, 95% CI = 0.27 to 0.39). There was 100% agreement in classifications among assessors for 70% of participants.Discussion
The MDT system has moderate reliability when classifying lumbar pain in adolescents and young adults. Future reliability studies may include a balanced group for classifications or a second session.
SUBMITTER: Chan M
PROVIDER: S-EPMC8366654 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:ObjectiveThe McKenzie System of Mechanical Diagnosis and Therapy (MDT) is a widely used method of classification and management of musculoskeletal problems. Although MDT has been investigated for its reliability and efficacy in the management of spinal pain, few studies have evaluated the system when applying it to musculoskeletal problems in the extremities, in particular the knee. The purpose of this study was to investigate the inter-rater reliability of MDT when classifying clinical vignettes describing patients with musculoskeletal knee pain.MethodsThis study was divided into two phases. First, 10 clinicians experienced in the use of MDT were recruited to write a total of 60 clinical vignettes based upon the initial assessment of their past patients with knee pain. Second, six different MDT raters were recruited to rate 53 selected vignettes and reliability was determined using Fleiss Kappa.ResultsThere was 'substantial agreement' among six MDT raters classifying the clinical vignettes into one of four categories (κ = 0.72). There was no statistically significant difference between therapists with different levels of training.DiscussionMDT demonstrated acceptable reliability among trained raters to classify clinical vignettes describing patients with musculoskeletal knee pain. To generalize the use of the system to more users, future research should continue to investigate the reliability of MDT using raters with lower levels of training and experience and assess reliability in real patients.Level of evidence5.
| S-EPMC5430453 | biostudies-literature
Project description:On two occasions, five surgeons classified a cohort of 150 consecutive patients with congenital upper limb anomalies according to the Oberg-Manske-Tonkin classification (2020 update). We estimated reliability for the main anomaly code by means of Cohen's kappa (Κ) for ten rater pairs for five common and easily distinguishable anomalies (Group 1), and for all the other anomalies (Group 2). Inter-rater reliability for all patients (n = 150) was substantial, almost perfect for Group 1 (n = 64), but only moderate for Group 2 (n = 86). Intra-rater reliability was higher for all groups. We suggest simplifications to the Oberg-Manske-Tonkin classification and highlight specific requirements for instructions to increase its reliability.Level of evidence: I.
| S-EPMC9634334 | biostudies-literature
Project description:Objective. The purpose of this study was to investigate the reliability of a digital pelvic inclinometer (DPI) for measuring sagittal plane pelvic tilt in 18 young, healthy males and females. Method. The inter-rater reliability and test-re-test reliabilities of the DPI for measuring pelvic tilt in standing on both the right and left sides of the pelvis were measured by two raters carrying out two rating sessions of the same subjects, three weeks apart. Results. For measuring pelvic tilt, inter-rater reliability was designated as good on both sides (ICC = 0.81-0.88), test-re-test reliability within a single rating session was designated as good on both sides (ICC = 0.88-0.95), and test-re-test reliability between two rating sessions was designated as moderate on the left side (ICC = 0.65) and good on the right side (ICC = 0.85). Conclusion. Inter-rater reliability and test-re-test reliability within a single rating session of the DPI in measuring pelvic tilt were both good, while test-re-test reliability between rating sessions was moderate-to-good. Caution is required regarding the interpretation of the test-re-test reliability within a single rating session, as the raters were not blinded. Further research is required to establish validity.
| S-EPMC4824902 | biostudies-literature
Project description:Schroth exercises for scoliosis are prescribed based on curve types. This study aimed to determine the reliability of an algorithm for classifying Schroth curve types. Forty-four consecutive volunteers with adolescent idiopathic scoliosis, 10 to 18 years old, with curves 10° to 50°, were recruited from a scoliosis clinic. Their standing posture and Adam's bending test were videotaped. Ten consecutive Schroth therapist volunteers from an international registry independently classified the curve types using the proposed classification algorithm. Videos were rated twice at least seven days apart. Reliability was calculated using the Gwet's AC1 agreement coefficient for all the raters and for subgroups reporting full understanding (well-trained) and with prior algorithm experience. The intra-rater and weighted agreement coefficients for all the raters were 0.64 (95% CI: 0.53-0.73) and 0.75 (0.63-0.84), respectively. For the well-trained raters, they were 0.70 (0.60-0.78) and 0.82 (0.73-0.88), respectively; for the experienced raters, they were 0.81 (0.77-0.85) and 0.89 (0.80-0.94), respectively. The inter-rater versus weighted agreement coefficients for all the raters were 0.43 (0.28-0.58) versus 0.48 (0.29-0.67). For the well-trained raters, they were 0.50 (0.38-0.61) versus 0.61 (0.49-0.72), and for the experienced raters, they were 0.67 (0.50-0.85) versus 0.79 (0.64-0.94). Full understanding and experience led to higher reliability. Use of the algorithm can help standardize Schroth exercise treatment.
| S-EPMC10047876 | biostudies-literature
Project description:Background: Non-invasive Doppler waveform (DW) analysis is a widely adopted method for detecting and evaluating lower extremity peripheral artery disease (PAD). Previous investigations have reported that broad heterogeneity in the description of Doppler waveforms is reduced by using a classification method. The reliability of arterial Doppler classification, however, is unknown. Purpose: The purpose of this study is to assess the reliability of a 4-category arterial DW classification method among Chinese sonographers. Methods: During a national ultrasound conference in China attendees were invited to classify thirty arterial Doppler waveforms. After viewing a 4-category (triphasic, biphasic, monophasic, and other) arterial Doppler waveform descriptor presentation, attendees were asked to classify 15 continuous wave (CW) and 15 pulsed wave (PW) Doppler waveforms. Their responses were recorded via mobile phone and the reliability of this 4-category classification was estimated by Fleiss' Kappa inter-rater statistical analysis. Results: One hundred and seventy-eight attendees participated in the analysis. The Kappa coefficient of Fleiss (κ) for all attendees was 0.522 (p < 0.005) with 95% confidence interval (CI): 0.520-0.523. The reliability of the waveform descriptor triphasic was the highest (κ = 0.621, p < 0.005), and other was the lowest (κ = 0.341, p < 0.005). Conclusion: The inter-rater reliability of a 4-category arterial Doppler waveform classification by Chinese sonographers is considered weak (κ = 0.522, CI95%: 0.520-0.523, p < 0.005). This study reinforces the importance of assessing DW classification reliability and the development of DW descriptors that are more accurately predictive of clinical hemodynamic events.
| S-EPMC7649166 | biostudies-literature
Project description:Background: Arterial Doppler Ultrasound waveform (DW) analysis allows the detection and evaluation of lower extremity peripheral artery disease. The high heterogeneity of the reported description of DW is reduced by the use of classification. However, the reliability of these classifications is either unknown or low to moderate and practices of vascular caregivers regarding the use of these classifications remain unknown. Aims: This study aims to assess the inter-observer reliability of the Saint-Bonnet classification, a 13-category DW classification. The secondary objective was to determine the utilization rate of the most common classifications and the ability of these classifications to describe DW. Methods: A national survey was conducted among all vascular physicians of French society of vascular medicine. They were invited by email to describe on a website 20 DW without and with the display of the Saint-Bonnet classification. The reliability of this classification was estimated by Fleiss' Kappa expressed with [95% confidence interval]. A semantic analysis allowed us to classify the physicians' responses according to the terms used. Finally we have evaluated for each classification the rate of misuse, i.e., the addition of a complementary term to the defined categories. Results: One hundred and ten physicians participated and only 5% of these were familiar with Saint-Bonnet classification. Fifty-four percent of vascular physicians used no classification at all. Vascular physicians used the Spronk (four-category), Descotes (five-category) and Saint-Bonnet (13-category) classifications for respectively, 31, 10, and 5%. Kappa coefficient of Fleiss (κ) was 0.546 [0.544-0.547] (p < 0.001). Reliability by category ranges from κ of 0.075 to 0.864. In multivariate analysis, the use of a classification was associated with fewer years of experience and was dependent on geographic location. Misuse rate by classification was 88, 82, and 5% using Spronk, Descotes and Saint-Bonnet classifications respectively. Conclusion: The reliability of Saint-Bonnet classification is weak to moderate by vascular physicians who are not familiar with its use. However, unlike the other classifications, it seems to be sufficiently precise so that the user does not need to complete its description. There is a significant heterogeneity in the use of arterial Doppler classifications in France.
| S-EPMC8185013 | biostudies-literature
Project description:BACKGROUND:To analyse the reliability, variance and execution time of the Extended Timed Up and Go (Extended TUG) test in three age groups of elderly participants (G1: 55-64?years; G2: 65-74?years; G3: 75-85?years). METHODS:An analytical cross-sectional study of 114 recruited participants (63 women) of average age 70.17 (± 7.3) years was undertaken. Each participant performed the Extended TUG three consecutive times, with a rest break between tests of 120?s. Both the intragroup and intergroup reliability of the measurements in the Extended TUG were analysed. RESULTS:The reliability of the Extended TUG test is excellent for the first and second decades but drops down to good for the third decade. Specifically, intragroup reliability ranged from 0.784 for G3 to 0.977 for G1 (G2?=?0.858). Intergroup reliability, compared with intragroup reliability, was slightly lower, ranging between 0.779 for G3 and 0.972 for G1 (G2?=?0.853). CONCLUSION:The reliability of the Extended TUG test progressively decreases with increasing age, being excellent for the younger age groups and good for the oldest age group.
| S-EPMC7020600 | biostudies-literature
Project description:Near falls (NFs) are more frequent than falls, and may occur before falls, potentially predicting fall risk. As such, identification of a NF is important. We aimed to assess intra and inter-rater reliability of the traditional definition of a NF and to demonstrate the potential utility of a new definition. To this end, 10 older adults, 10 idiopathic elderly fallers, and 10 patients with Parkinson's disease (PD) walked in an obstacle course while wearing a safety harness. All walks were videotaped. Forty-nine video segments were extracted to create 2 clips each of 8.48 min. Four raters scored each event using the traditional definition and, two weeks later, using the new definition. A fifth rater used only the new definition. Intra-rater reliability was determined using Kappa (K) statistics and inter-rater reliability was determined using ICC. Using the traditional definition, three raters had poor intra-rater reliability (K<0.054, p>0.137) and one rater had moderate intra-rater reliability (K=0.624, p<0.001). With the traditional definition, inter-rater reliability between the four raters was moderate (ICC=0.667, p<0.001). In contrast, the new NF definition showed high intra-rater (K>0.601, p<0.001) and excellent inter-rater reliability (ICC=0.815, p<0.001). A priori, it is easy to distinguish falls from usual walking and NFs, but it is more challenging to distinguish NFs from obstacle negotiation and usual walking. Therefore, a more precise definition of NF is required. The results of the present study suggest that the proposed new definition increases intra and inter-rater reliability, a critical step for using NFs to quantify fall risk.
| S-EPMC3842362 | biostudies-literature
Project description:PurposeCerebral Performance Category (CPC) scores are often an outcome measure for post-arrest neurologic function, collected worldwide to compare performance, evaluate therapies, and formulate recommendations. At most institutions, no formal training is offered in their determination, potentially leading to misclassification.Materials and methodsWe identified 171 patients at 2 hospitals between 5/10/2005 and 8/31/2012 with two CPC scores at hospital discharge recorded independently - in an in-house quality improvement database and as part of a national registry. Scores were abstracted retrospectively from the same electronic medical record by two separate non-clinical researchers. These scores were compared to assess inter-rater reliability and stratified based on whether the score was concordant or discordant among reviewers to determine factors related to discordance.ResultsThirty-nine CPC scores (22.8%) were discordant (kappa: 0.66), indicating substantial agreement. When dichotomized into "favorable" neurologic outcome (CPC 1-2)/"unfavorable" neurologic outcome (CPC 3-5), 20 (11.7%) scores were discordant (kappa: 0.70), also indicating substantial agreement. Patients discharged home (as opposed to nursing/other care facility) and patients with suspected cardiac etiology of arrest were statistically more likely to have concordant scores. For the quality improvement database, patients with discordant scores had a statistically higher median CPC score than those with concordant scores. The registry had statistically lower median CPC score (CPC 1) than the quality improvement database (CPC 2); p<0.01 for statistical significance.ConclusionsCPC scores have substantial inter-rater reliability, which is reduced in patients who have worse outcomes, have a non-cardiac etiology of arrest, and are discharged to a location other than home.
| S-EPMC5990009 | biostudies-literature
Project description:BackgroundThe clinical examination for laxity has been considered a mainstay in evaluation of the painful knee arthroplasty, especially for the diagnosis of instability. More than 10 mm of anterior-posterior (AP) translation in flexion has been described as important in the diagnosis of flexion instability. The inter-observer reliability of varus/valgus and AP laxity testing has not been tested.MethodsTen subjects with prior to total knee arthroplasty (TKA) were examined by 4 fellowship-trained orthopedic knee arthroplasty surgeons. Each surgeon evaluated each subject in random order and was blinded to the results of the other surgeons. Each surgeon performed an anterior drawer test at 30 and 90 degrees of flexion and graded the instability as 0-5 mm, 5-10 mm or >10 mm. Varus-valgus testing was also graded. Motion capture was used during the examination to determine the joint position and estimate joint reaction force during the examination.ResultsInter-rater reliability (IRR) was poor at 30 and 90 degrees for both the subjective rater score and the measured AP laxity in flexion (k = 018-0.22). Varus-valgus testing similarly had poor reliability. Force applied by the rater also had poor IRR.ConclusionClinical testing of knee laxity after TKA has poor reliability between surgeons using motion analysis. It is unclear if this is from differences in examiner technique or from differences in pain or quadriceps function of the subjects. Instability after TKA should not be diagnosed strictly by clinical testing and should involve a complete clinical assessment of the patient.
| S-EPMC9177712 | biostudies-literature