Intra- and inter-rater reliability of neutral head position and target head position tests in patients with and without neck pain.
Ontology highlight
ABSTRACT:
SUBMITTER: Alahmari K
PROVIDER: S-EPMC5537472 | biostudies-other | 2017 Jul - Aug
REPOSITORIES: biostudies-other
Similar Datasets
Project description:BACKGROUND:To analyse the reliability, variance and execution time of the Extended Timed Up and Go (Extended TUG) test in three age groups of elderly participants (G1: 55-64?years; G2: 65-74?years; G3: 75-85?years). METHODS:An analytical cross-sectional study of 114 recruited participants (63 women) of average age 70.17 (± 7.3) years was undertaken. Each participant performed the Extended TUG three consecutive times, with a rest break between tests of 120?s. Both the intragroup and intergroup reliability of the measurements in the Extended TUG were analysed. RESULTS:The reliability of the Extended TUG test is excellent for the first and second decades but drops down to good for the third decade. Specifically, intragroup reliability ranged from 0.784 for G3 to 0.977 for G1 (G2?=?0.858). Intergroup reliability, compared with intragroup reliability, was slightly lower, ranging between 0.779 for G3 and 0.972 for G1 (G2?=?0.853). CONCLUSION:The reliability of the Extended TUG test progressively decreases with increasing age, being excellent for the younger age groups and good for the oldest age group.
| S-EPMC7020600 | biostudies-literature
Project description:Near falls (NFs) are more frequent than falls, and may occur before falls, potentially predicting fall risk. As such, identification of a NF is important. We aimed to assess intra and inter-rater reliability of the traditional definition of a NF and to demonstrate the potential utility of a new definition. To this end, 10 older adults, 10 idiopathic elderly fallers, and 10 patients with Parkinson's disease (PD) walked in an obstacle course while wearing a safety harness. All walks were videotaped. Forty-nine video segments were extracted to create 2 clips each of 8.48 min. Four raters scored each event using the traditional definition and, two weeks later, using the new definition. A fifth rater used only the new definition. Intra-rater reliability was determined using Kappa (K) statistics and inter-rater reliability was determined using ICC. Using the traditional definition, three raters had poor intra-rater reliability (K<0.054, p>0.137) and one rater had moderate intra-rater reliability (K=0.624, p<0.001). With the traditional definition, inter-rater reliability between the four raters was moderate (ICC=0.667, p<0.001). In contrast, the new NF definition showed high intra-rater (K>0.601, p<0.001) and excellent inter-rater reliability (ICC=0.815, p<0.001). A priori, it is easy to distinguish falls from usual walking and NFs, but it is more challenging to distinguish NFs from obstacle negotiation and usual walking. Therefore, a more precise definition of NF is required. The results of the present study suggest that the proposed new definition increases intra and inter-rater reliability, a critical step for using NFs to quantify fall risk.
| S-EPMC3842362 | biostudies-literature
Project description:ObjectivesTo investigate the intra- and inter-rater reliability of the total radiomics quality score (RQS) and the reproducibility of individual RQS items' score in a large multireader study.MethodsNine raters with different backgrounds were randomly assigned to three groups based on their proficiency with RQS utilization: Groups 1 and 2 represented the inter-rater reliability groups with or without prior training in RQS, respectively; group 3 represented the intra-rater reliability group. Thirty-three original research papers on radiomics were evaluated by raters of groups 1 and 2. Of the 33 papers, 17 were evaluated twice with an interval of 1 month by raters of group 3. Intraclass coefficient (ICC) for continuous variables, and Fleiss' and Cohen's kappa (k) statistics for categorical variables were used.ResultsThe inter-rater reliability was poor to moderate for total RQS (ICC 0.30-055, p < 0.001) and very low to good for item's reproducibility (k - 0.12 to 0.75) within groups 1 and 2 for both inexperienced and experienced raters. The intra-rater reliability for total RQS was moderate for the less experienced rater (ICC 0.522, p = 0.009), whereas experienced raters showed excellent intra-rater reliability (ICC 0.91-0.99, p < 0.001) between the first and second read. Intra-rater reliability on RQS items' score reproducibility was higher and most of the items had moderate to good intra-rater reliability (k - 0.40 to 1).ConclusionsReproducibility of the total RQS and the score of individual RQS items is low. There is a need for a robust and reproducible assessment method to assess the quality of radiomics research.Clinical relevance statementThere is a need for reproducible scoring systems to improve quality of radiomics research and consecutively close the translational gap between research and clinical implementation.Key points• Radiomics quality score has been widely used for the evaluation of radiomics studies. • Although the intra-rater reliability was moderate to excellent, intra- and inter-rater reliability of total score and point-by-point scores were low with radiomics quality score. • A robust, easy-to-use scoring system is needed for the evaluation of radiomics research.
| S-EPMC10957586 | biostudies-literature
Project description:PurposeThe purpose of this study was to assess the inter-rater reliability of 3 common physical examination assessments, the Q-angle, J-sign, and apprehension test, used to evaluate patients presenting with recurrent lateral patellofemoral instability.MethodsA consecutive sample of 38 subjects with recurrent lateral patellofemoral instability in 2013 were included in this reliability study. Two orthopaedic surgeons performed the physical examination maneuvers blinded to each other. The physical examination tests were performed bilaterally and included the Q angle, the J-sign, and the apprehension test. To measure the inter-rater reliability, an intraclass correlation coefficient (ICC 2,κ) was used for both legs independently for Q-angle measurements. A Cohen's kappa was used to measure the inter-rater reliability for the J-sign and the apprehension test.ResultsThe measurement of the Q-angle demonstrated poor reliability (ICC 2,κ 0.18-0.44). The assessment of the J-sign demonstrated fair to moderate reliability (κ = 0.31 - 0.41), and the evaluation of apprehension demonstrated fair to substantial reliability (κ = 0.30 - 0.65). All 3 clinical tests demonstrated substantial variability comparing the reliability on the right and left limbs. Assessment of the quality of apprehension demonstrated good agreement between the examiners.ConclusionsIn this study of patients with recurrent lateral patellofemoral instability the common physical examination tests, Q-angle, J-sign, and apprehension demonstrated weak inter-rater reliability. These results indicate that these tests are not reliable for communication between health care practitioners or as evaluations for clinical research.Level of evidenceLevel IV, therapeutic case series.
| S-EPMC8220568 | biostudies-literature
Project description:BackgroundIn clinical practice range of motion (RoM) is usually assessed with low-cost devices such as a tape measure (TM) or a digital inclinometer (DI). However, the intra- and inter-rater reliability of typical RoM tests differ, which impairs the evaluation of therapy progress. More objective and reliable kinematic data can be obtained with the inertial motion capture system (IMC) by Xsens. The aim of this study was to obtain the intra- and inter-rater reliability of the TM, DI and IMC methods in five RoM tests: modified Thomas test (DI), shoulder test modified after Janda (DI), retroflexion of the trunk modified after Janda (DI), lateral inclination (TM) and fingertip-to-floor test (TM).MethodsTwo raters executed the RoM tests (TM or DI) in a randomized order on 22 healthy individuals while, simultaneously, the IMC data (Xsens MVN) was collected. After 15 warm-up repetitions, each rater recorded five measurements.FindingsIntra-rater reliabilities were (almost) perfect for tests in all three devices (ICCs 0.886-0.996). Inter-rater reliability was substantial to (almost) perfect in the DI (ICCs 0.71-0.87) and the IMC methods (ICCs 0.61-0.993) and (almost) perfect in the TM methods (ICCs 0.923-0.961). The measurement error (ME) for the tests measured in degree (°) was 0.9-3.3° for the DI methods and 0.5-1.2° for the IMC approaches. In the tests measured in centimeters the ME was 0.5-1.3cm for the TM methods and 0.6-2.7cm for the IMC methods. Pearson correlations between the results of the DI or the TM respectively with the IMC results were significant in all tests except for the shoulder test on the right body side (r = 0.41-0.81).InterpretationMeasurement repetitions of either one or multiple trained raters can be considered reliable in all three devices.
| S-EPMC7728246 | biostudies-literature
Project description:The Revised Hammersmith Scale (RHS) for Spinal Muscular Atrophy (SMA) was designed as a psychometrically robust clinical outcome assessment to assess physical abilities of patients with type 2 and 3 SMA. The reliability properties of the RHS have not yet been reported. A prospective RHS reliability study was undertaken in a UK cohort of experienced neuromuscular paediatric Physiotherapists. Reliability testing was conducted via a virtual survey platform two weeks apart. Through the virtual platform participants scored videos of two RHS assessments, one of a child with SMA 2 and one of a child with SMA 3. Inter and intra-rater reliability was analysed using a type 3 Intraclass Correlation Coefficient (ICC). Intra-rater agreement was further analysed using Bland Altman (BA) Limits of Agreement (LOA) and plots. The acceptable inter and intra-rater variability was set as a change of ± 2 by the international team of expert physiotherapists who developed the RHS. Inter-rater agreement, n = 22 raters, type 3 ICC was 0.989 (95% CI 0.944 to 1.00), 97.7% of scores were within the acceptable limits of ± 2 points. Intra-rater agreement, n = 21 raters, type 3 ICC ranged from 0.922 to 1.0, with 97.6% of scores within the acceptable limits of ± 2 points. The mean SMA 2 intra-rater difference was -0.10 (-0.6 to 0.4), with lower LOA -2.24 and upper LOA +2.04. Intra-rater difference between tests for SMA 3 intra-rater difference was -0.05 (-0.6 to 0.5), with lower LOA -2.48 and upper LOA +2.38. Intra-rater scoring precision fell within BA agreement limits of ±2 points. The results demonstrate that the RHS is highly reliable when used by experienced UK physiotherapists, and variability of test scores regarding inter and intra-rater reliability was confirmed to lie within ±2 points.
| S-EPMC9770369 | biostudies-literature
Project description:Spatial frequency analysis (SFA) is a quantitative ultrasound (US) method originally developed to assess intratendinous tissue structure. This method may also be advantageous in assessing other musculoskeletal tissues. Although SFA has been shown to be a reliable assessment strategy in tendon tissue, its reliability in muscle has not been investigated. The purpose of this study was to examine the reliability of spatial frequency parameter measurement for a large muscle group within a healthy population. Ten participants with no history of lower extremity surgery or hamstring strain injury volunteered. Longitudinal B-mode images were collected in three different locations across the hamstring muscles. Following a short rest, the entire imaging procedure was repeated. B-mode images were processed by manually drawing a region of interest (ROI) about the entire muscle thickness. Four spatial frequency parameters of interest were extracted from the image ROIs. Intra- and inter-rater reliabilities of extracted SFA parameters were performed. Test-retest reliability of the image acquisition procedure was assessed between repeat trials. Intraclass correlation coefficients showed high intra- and inter-rater reliability (ICC(3,1) > 0.9 for all parameters) and good to moderate test-retest reliability (ICC(3,1) > 0.50) between trials. No differences in parameter values were observed between trials across all muscles and locations (p > 0.05). The high reliability metrics suggest that SFA will be useful for future studies assessing muscle tissue structure, and may have value in assessing muscular adaptations following injury and during recovery.
| S-EPMC7351217 | biostudies-literature
Project description:BackgroundHead-eye movement control deficit is an identified problem in patients with chronic neck pain, particularly in cases of whiplash associated disorders (WAD). To date, there is no evidence concerning the reliability and validity of visually assessed active head-eye movement control tests. Therefore, the objectives of the present cross-sectional study were, a) to develop a test battery; and b) to investigate inter-observer reliability and discriminative validity in patients with chronic neck pain compared to healthy controls.MethodsThe study was conducted at two physiotherapy clinics in Switzerland. Ethics Committee approval was obtained. Ten active head-eye coordination tests, on 23 patients with chronic neck pain and associated symptoms and 19 healthy controls, were videotaped. The tests included eye movements in the neutral head position and 45° relative neck rotation, gaze stability and sequential head-eye movements. All tests were performed in the sitting and standing positions. Two blinded physiotherapists independently rated the randomized videos. Performance was rated as "negative", "moderately positive" or "clearly positive". Weighted kappa (wK) and 95% confidence intervals (CI) were calculated to investigate inter-observer reliability. Good reliability was defined as wK >0.5 with a lower boundary of 95% CI >0.2. Odds ratios (to define cut-off points) and the distribution of the classificator, numbers of positive tests, were calculated.ResultsThree out of ten tests showed "excellent" (wK 0.82 to 0.86), five out of ten tests showed "substantial" (wK 0.69 to 0.79) and two out of ten tests showed "moderate" (wK 0.54 to 0.59) reliability. Results were comparable in the sitting and standing positions. On average, three out of five tests were rated positive in patients and one out of five tests was rated positive in healthy controls. An odds ratio of 13.3 to 18.6 was obtained using ?2/5 tests as a cut-off point.ConclusionVisual assessment by physiotherapists of head-eye movement control tests is reliable. The test battery is able to discriminate between patients with chronic neck pain and healthy controls. There were no differences in performance between the sitting and standing positions. The test battery can therefore be reduced to five tests. Further research is needed to identify the test-retest stability and responsiveness.
| S-EPMC3893395 | biostudies-literature
Project description:BACKGROUND:There is a growing trend in the use of mobile health (mHealth) technologies in traditional Chinese medicine (TCM) and telemedicine, especially during the coronavirus disease (COVID-19) outbreak. Tongue diagnosis is an important component of TCM, but also plays a role in Western medicine, for example in dermatology. However, the procedure of obtaining tongue images has not been standardized and the reliability of tongue diagnosis by smartphone tongue images has yet to be evaluated. OBJECTIVE:The first objective of this study was to develop an operating classification scheme for tongue coating diagnosis. The second and main objective of this study was to determine the intra-rater and inter-rater reliability of tongue coating diagnosis using the operating classification scheme. METHODS:An operating classification scheme for tongue coating was developed using a stepwise approach and a quasi-Delphi method. First, tongue images (n=2023) were analyzed by 2 groups of assessors to develop the operating classification scheme for tongue coating diagnosis. Based on clinicians' (n=17) own interpretations as well as their use of the operating classification scheme, the results of tongue diagnosis on a representative tongue image set (n=24) were compared. After gathering consensus for the operating classification scheme, the clinicians were instructed to use the scheme to assess tongue features of their patients under direct visual inspection. At the same time, the clinicians took tongue images of the patients with smartphones and assessed tongue features observed in the smartphone image using the same classification scheme. The intra-rater agreements of these two assessments were calculated to determine which features of tongue coating were better retained by the image. Using the finalized operating classification scheme, clinicians in the study group assessed representative tongue images (n=24) that they had taken, and the intra-rater and inter-rater reliability of their assessments was evaluated. RESULTS:Intra-rater agreement between direct subject inspection and tongue image inspection was good to very good (Cohen ? range 0.69-1.0). Additionally, when comparing the assessment of tongue images on different days, intra-rater reliability was good to very good (? range 0.7-1.0), except for the color of the tongue body (?=0.22) and slippery tongue fur (?=0.1). Inter-rater reliability was moderate for tongue coating (Gwet AC2 range 0.49-0.55), and fair for color and other features of the tongue body (Gwet AC2=0.34). CONCLUSIONS:Taken together, our study has shown that tongue images collected via smartphone contain some reliable features, including tongue coating, that can be used in mHealth analysis. Our findings thus support the use of smartphones in telemedicine for detecting changes in tongue coating.
| S-EPMC7380897 | biostudies-literature
Project description:Study designCross sectional.ObjectivesTo determine the inter-rater and intra-rater reliability of the Spanish version of the Berg Balance Scale with incomplete spinal cord injured subjects.SettingCINER Rehabilitation Center.MethodsWe administered and video recorded the Spanish version of the Berg Balance Scale to 20 incomplete SCI patients. Two raters scored the videos on two different occasions at least three weeks apart. We used intraclass correlation coefficient (ICC) and a confidence interval (CI) of 95% to evaluate the inter-rater and intra-rater (test-retest) reliability of the BBS total scores.ResultsICC values for inter-rater reliability at first and second observation were 0.99 (95% CI 0.97-1.00) and 0.99 (95% CI 0.99-1.00), respectively. Intra-rater ICC for rater 1 was 1.00 (95% CI 1.00-1.00) and for rater 2 was 1.00 (95% CI 0.99-1.00). All of them were excellent.ConclusionsThe results indicate that the Spanish version of the Berg Balance Scale is a reliable tool to evaluate spinal cord injured patients' balance.
| S-EPMC7189380 | biostudies-literature