Dataset Information

Reliability and validity of motion analysis in children treated for congenital clubfoot according to the Clubfoot Assessment Protocol (CAP) using inexperienced assessors.

ABSTRACT:

Background

The Clubfoot Assessment Protocol (CAP) was developed for follow-up of children treated for clubfoot. The objective of this study was to analyze reliability and validity of the six items used in the domain CAPMotion Quality using inexperienced assessors.

Findings

Four raters (two paediatric orthopaedic surgeons, two senior physiotherapists) used the CAP scores to analyze, on two different occasions, 11 videotapes containing standardized recordings of motion activity according to the domain CAPMotion Quality These results were compared to a criterion (two raters, well experienced CAP assessors) for validity and for checking for learning effect.Weighted kappa statistics, exact percentage observer agreement (Po), percentage observer agreement including one level difference (Po-1) and amount of scoring scales defined how reliability was to be interpreted. Inter- and intra rater differences were calculated using median and inter quartile ranges (IQR) on item level and mean and limits of agreement on domain level.Inter-rater reliability varied between fair and moderate (kappa) and had a mean agreement of 48/88% (Po/Po-1). Intra -rater reliability varied between moderate to good with a mean agreement of 63/96%. The intra- and inter-rater differences in the present study were generally small both on item (0.00) and domain level (-1.10). There was exact agreement of 51% and Po-1 of 91% of the six items with the criterion. No learning effect was found.

Conclusion

The CAPMotion quality can be used by inexperienced assessors with sufficient reliability in daily clinical practice and showed acceptable accuracy compared to the criterion.

SUBMITTER: Andriesse H

PROVIDER: S-EPMC2705375 | biostudies-literature | 2009 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reliability and validity of motion analysis in children treated for congenital clubfoot according to the Clubfoot Assessment Protocol (CAP) using inexperienced assessors.

Andriesse Hanneke H Hägglund Gunnar G Isberg Per-Erik PE

BMC research notes 20090612

<h4>Background</h4>The Clubfoot Assessment Protocol (CAP) was developed for follow-up of children treated for clubfoot. The objective of this study was to analyze reliability and validity of the six items used in the domain CAPMotion Quality using inexperienced assessors.<h4>Findings</h4>Four raters (two paediatric orthopaedic surgeons, two senior physiotherapists) used the CAP scores to analyze, on two different occasions, 11 videotapes containing standardized recordings of motion activity acco ...[more]

PMID: 19523200

Similar Datasets

Project description:BackgroundIn epidemiologic studies that rely on professional judgment to assess occupational exposures, the raters' accurate assessment is vital to detect associations. We examined the influence of the type of questionnaire, type of industry, and type of rater on the raters' ability to reliably and validly assess within-industry differences in exposure. Our aim was to identify areas where improvements in exposure assessment may be possible.MethodsSubjects from three foundries (n = 72) and three textile plants (n = 74) in Shanghai, China, completed an occupational history (OH) and an industry-specific questionnaire (IQ). Six total dust measurements were collected per subject and were used to calculate a subject-specific measurement mean, which was used as the gold standard. Six raters independently ranked the intensity of each subject's current job on an ordinal scale (1-4) based on the OH alone and on the OH and IQ together. Aggregate ratings were calculated for the group, for industrial hygienists, and for occupational physicians. We calculated intra-class correlation coefficients (ICCs) to evaluate the reliability of the raters. We calculated the correlation between the subject-specific measurement means and the ratings to evaluate the raters' validity. Analyses were stratified by industry, type of questionnaire, and type of rater. We also examined the agreement between the ratings by exposure category, where the subject-specific measurement means were categorized into two and four categories.ResultsThe reliability and validity measures were higher for the aggregate ratings than for the ratings from the individual raters. The group's performance was maximized with three raters. Both the reliability and validity measures were higher for the foundry industry than for the textile industry. The ICCs were consistently lower in the OH/IQ round than in the OH round in both industries. In contrast, the correlations with the measurement means were higher in the OH/IQ round than in the OH round for the foundry industry (group rating, OH/IQ: Spearman rho = 0.77; OH: rho = 0.64). No pattern by questionnaire type was observed for the textile industry (group rating, Spearman rho = 0.50, both assessment rounds). For both industries, the agreement by exposure category was higher when the task was reduced to discriminating between two versus four exposure categories.ConclusionsAssessments based on professional judgment may reduce misclassification by using two or three raters, by using questionnaires that systematically collect task information, and by defining intensity categories that are distinguishable by the raters. However, few studies have the resources to use multiple raters and these additional efforts may not be adequate for obtaining valid subjective ratings. Thus, improving exposure assessment approaches for studies that rely on professional judgment remain an important research need.

Project description:BackgroundIdiopathic congenital talipes equinovarus (CTEV) is the commonest form of clubfoot. Its exact cause is unknown, although it is related to limb development. The aim of this study was to quantify the anatomy of the muscle, subcutaneous fat, tibia, fibula and arteries in the lower legs of teenagers and young adults with CTEV using 3D magnetic resonance imaging (MRI), and thus to investigate the anatomical differences between CTEV participants and controls.Methodology/principal findingsThe lower legs of six CTEV (2 bilateral, 4 unilateral) and five control young adults (age 12-28) were imaged using a 3T MRI Philips scanner. 5 of the CTEV participants had undergone soft-tissue and capsular release surgery. 3D T1-weighted and 3D magnetic resonance angiography (MRA) images were acquired. Segmentation software was used for volumetric, anatomical and image analysis. Kolmogorov-Smirnov tests were performed. The volumes of the lower affected leg, muscle, tibia and fibula in unilateral CTEV participants were consistently smaller compared to their contralateral unaffected leg, this was most pronounced in muscle. The proportion of muscle in affected CTEV legs was significantly reduced compared with control and unaffected CTEV legs, whilst proportion of muscular fat increased. No spatial abnormalities in the location or branching of arteries were detected, but hypoplastic anomalies were observed.Conclusions/significanceCombining 3D MRI and MRA is effective for quantitatively characterizing CTEV anatomy. Reduction in leg muscle volume appears to be a sensitive marker. Since 5/6 CTEV cases had soft-tissue surgery, further work is required to confirm that the treatment did not affect the MRI features observed. We propose that the proportion of muscle and intra-muscular fat within the lower leg could provide a valuable addition to current clinical CTEV classification. These measures could be useful for clinical care and guiding treatment pathways, as well as treatment research and clinical audit.

Project description:BackgroundElbow and wrist chronic conditions are very common among musculoskeletal problems. These painful conditions affect muscle function, which ultimately leads to a decrease in the joint's Range Of Motion (ROM). Due to their portability and ease of use, goniometers are still the most widespread tool for measuring ROM. Inertial sensors are emerging as a digital, low-cost and accurate alternative. However, whereas inertial sensors are commonly used in research studies, due to the lack of information about their validity and reliability, they are not widely used in the clinical practice. The goal of this study is to assess the validity and intra-inter-rater reliability of inertial sensors for measuring active ROM of the elbow and wrist.Materials and methodsMeasures were taken simultaneously with inertial sensors (Werium™ system) and a universal goniometer. The process involved two physiotherapists ("rater A" and "rater B") and an engineer responsible for the technical issues. Twenty-nine asymptomatic subjects were assessed individually in two sessions separated by 48 h. The procedure was repeated by rater A followed by rater B with random order. Three repetitions of each active movement (elbow flexion, pronation, and supination; and wrist flexion, extension, radial deviation and ulnar deviation) were executed starting from the neutral position until the ROM end-feel; that is, until ROM reached its maximum due to be stopped by the anatomy. The coefficient of determination (r 2) and the Intraclass Correlation Coefficient (ICC) were calculated to assess the intra-rater and inter-rater reliability. The Standard Error of the Measurement and the Minimum Detectable Change and a Bland-Altman plots were also calculated.ResultsSimilar ROM values when measured with both instruments were obtained for the elbow (maximum difference of 3° for all the movements) and wrist (maximum difference of 1° for all the movements). These values were within the normal range when compared to literature studies. The concurrent validity analysis for all the movements yielded ICC values ≥0.78 for the elbow and ≥0.95 for the wrist. Concerning reliability, the ICC values denoted a high reliability of inertial sensors for all the different movements. In the case of the elbow, intra-rater and inter-rater reliability ICC values range from 0.83 to 0.96 and from 0.94 to 0.97, respectively. Intra-rater analysis of the wrist yielded ICC values between 0.81 and 0.93, while the ICC values for the inter-rater analysis range from 0.93 to 0.99.ConclusionsInertial sensors are a valid and reliable tool for measuring elbow and wrist active ROM. Particularly noteworthy is their high inter-rater reliability, often questioned in measurement tools. The lowest reliability is observed in elbow prono-supination, probably due to skin artifacts. Based on these results and their advantages, inertial sensors can be considered a valid assessment tool for wrist and elbow ROM.

Project description:BACKGROUND:New reliable devices for range of motion (ROM) measures in older adults are necessary to improve knowledge about the functional capability in this population. Dorsiflexion ROM limitation is associated with ankle injuries, foot pain, lower limb disorders, loss of balance, gait control disorders and fall risk in older adults. The aim of the present study was to assess the validity and reliability of the Leg Motion device for measuring ankle dorsiflexion ROM in older adults. METHODS:Adescriptive repeated-measures study was designed to test the reliability of Leg Motion in thirty-three healthy elderly patients older than 65 years. The subjects had to meet the following inclusion and exclusion criteria in their medical records: older than 65 years; no lower extremity injury for at least one year prior to evaluation (meniscopathy, or fractures) and any chronic injuries (e.g., osteoarthritis); no previous hip, knee or ankle surgery; no neuropathic alterations and no cognitive conditions (e.g., Alzheimer's disease or dementia). Participants were recruited through the person responsible for the physiotherapist area from a nursing center. The subjects were evaluated in two different sessions at the same time of day, and there was a break of two weeks between sessions. To test the validity of the Leg Motion system, the participants were measured in a weight-bearing lunge position using a classic goniometer with 1° increments, a smartphone with an inclinometer standard app (iPhone 5S®) with 1° increments and a measuring tape that could measure 0.1 cm. All testing was performed while the patients were barefoot. The researcher had ten years of experience as a physiotherapist using goniometer, tape measure and inclinometer devices. RESULTS:Mean values and standard deviations were as follows: Leg Motion (right 5.15 ± 3.08; left 5.19 ± 2.98), tape measure (right 5.12 ± 3.08; left 5.12 ± 2.80), goniometer (right 45.87° ± 4.98; left 44.50° ± 5.54) and inclinometer app (right 46.53° ± 4.79; left 45.27° ± 5.19). The paired t-test showed no significant differences between the limbs or between the test and re-test values. The test re-test reliability results for Leg Motion were as follows: the standard error of the measurement ranged from 0.29 to 0.43 cm, the minimal detectable difference ranged from 0.79 to 1.19 cm, and the intraclass correlation coefficients (ICC) values ranged from 0.97 to 0.98. CONCLUSIONS:The results of the present study indicated that the Leg Motion device is a valid, reliable, accessible and portable tool as an alternative to the classic weight-bearing lunge test for measuring ankle dorsiflexion ROM in older adults.

Project description:BackgroundThe clinimetric properties of knee goniometry are essential to appreciate in light of its extensive use in the orthopaedic and rehabilitative communities. Intra-observer reliability is thought to be satisfactory, but the validity and inter-rater reliability of knee goniometry often demonstrate unacceptable levels of variation. This study tests the validity and reliability of measuring knee range of motion using goniometry and photographic records.MethodsDesignMethodology study assessing the validity and reliability of one method ('Marker Method') which uses a skin marker over the greater trochanter and another method ('Line of Femur Method') which requires estimation of the line of femur.SettingRadiology and orthopaedic departments of two teaching hospitals.Participants31 volunteers (13 arthritic and 18 healthy subjects). Knee range of motion was measured radiographically and photographically using a goniometer. Three assessors were assessed for reliability and validity.Main outcomesAgreement between methods and within raters was assessed using concordance correlation coefficient (CCCs). Agreement between raters was assessed using intra-class correlation coefficients (ICCs). 95% limits of agreement for the mean difference for all paired comparisons were computed.ResultsValidity (referenced to radiographs): Each method for all 3 raters yielded very high CCCs for flexion (0.975 to 0.988), and moderate to substantial CCCs for extension angles (0.478 to 0.678). The mean differences and 95% limits of agreement were narrower for flexion than they were for extension. Intra-rater reliability: For flexion and extension, very high CCCs were attained for all 3 raters for both methods with slightly greater CCCs seen for flexion (CCCs varied from 0.981 to 0.998). Inter-rater reliability: For both methods, very high ICCs (min to max: 0.891 to 0.995) were obtained for flexion and extension. Slightly higher coefficients were obtained for flexion compared to extension, and with the Marker compared to the Line of Femur Method. For intra- and inter-rater reliability, the mean differences (within 2 degrees) and 95% limits of agreement (within 5 degrees) were generally clinically acceptable for both methods.ConclusionPhotography potentially offers a superior method of measurement over standard goniometry as visualising the centre of the knee is simplified in a two-dimensional plane and the permanent record provides greater assessor transparency as well as opportunity to confer. The Marker and Line of Femur Methods have moderate to substantial validity, but the inter- and intra-rater repeatability for trained observers are excellent with both methods yielding small mean differences with narrow limits of agreement. The Line of Femur Method offers the added advantage that it does not rely on inter-clinician consistency in identifying the greater trochanter.

Project description:BackgroundMuscle function may influence the risk of knee injury and outcomes following injury. Clinical tests, such as a single-limb mini squat, resemble conditions of daily life and are easy to administer. Fewer squats per 30 seconds indicate poorer function. However, the quality of movement, such as the medio-lateral knee motion may also be important. The aim was to validate an observational clinical test of assessing the medio-lateral knee motion, using a three-dimensional (3-D) motion analysis system. In addition, the inter-rater reliability was evaluated.MethodsTwenty-five (17 women) non-injured participants (mean age 25.6 years, range 18-37) were included. Visual analysis of the medio-lateral knee motion, scored as knee-over-foot or knee-medial-to-foot by two raters, and 3-D kinematic data were collected simultaneously during a single-limb mini squat. Frontal plane 2-D peak tibial, thigh, and knee varus-valgus angles, and 3-D peak hip internal-external rotation, and knee varus-valgus angles were calculated.ResultsTen subjects were scored as having a knee-medial-to-foot position and 15 subjects a knee-over-foot position assessed by visual inspection. In 2-D, the peak tibial angle (mean 89.0 (SE 0.7) vs mean 86.3 (SE 0.4) degrees, p = 0.001) and peak thigh angle (mean 77.4 (SE 1.0) vs mean 81.2 (SE 0.5) degrees, p = 0.001) with respect to the horizontal, indicated that the knee was more medially placed than the ankle and thigh, respectively. Thus, the knee was in more valgus (mean 11.6 (SE 1.5) vs 5.0 (SE 0.8) degrees, p < 0.001) in subjects with the knee-medial-to-foot than in those with a knee-over-foot position. In 3-D, the hip was more internally rotated in those with a knee-medial-to-foot than in those with a knee-over-foot position (mean 10.6 (SE 2.1) vs 4.8 (SE 1.8) degrees, p = 0.049), but there was no difference in knee valgus (mean 6.1 (SE 1.8) vs mean 5.0 (SE 1.2) degrees, p = 0.589). The kappa value and percent agreement, respectively, was >0.90 and 96 between raters.ConclusionsMedio-lateral motion of the knee can reliably be assessed during a single-leg mini-squat. The test is valid in 2-D, while the actual movement, in 3-D, is mainly exhibited as increased internal hip rotation. The single-limb mini squat is feasible and easy to administer in the clinical setting and in research to address lower extremity movement quality.

Dataset Information

Reliability and validity of motion analysis in children treated for congenital clubfoot according to the Clubfoot Assessment Protocol (CAP) using inexperienced assessors.

Background

Findings

Conclusion

Publications

Reliability and validity of motion analysis in children treated for congenital clubfoot according to the Clubfoot Assessment Protocol (CAP) using inexperienced assessors.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets