Dataset Information

Reliability, measurement error and minimum detectable change in mobility measures: a cohort study of community-dwelling adults aged 50 years and over in Ireland.

ABSTRACT: OBJECTIVE:To estimate the effects of repeat assessments, rater and time of day on mobility measures and to estimate their variation between and within participants in a population-based sample of Irish adults aged ?50 years. DESIGN:Test-retest study in a population representative sample. SETTING:Academic health assessment centre of The Irish Longitudinal Study on Ageing (TILDA). PARTICIPANTS:128 community-dwelling adults from the Survey for Health, Ageing and Retirement in Europe (SHARE) Ireland study who agreed to take part in the SHARE-Ireland/TILDA collaboration. INTERVENTIONS:Not applicable. OUTCOME MEASURES:Participants performed timed up-and-go (TUG), repeated chair stands (RCS) and walking speed tests administered by one of two raters. Repeat assessments were conducted 1-4 months later. Participants were randomised with respect to a change in time (morning, afternoon) and whether the rater was changed between assessments. Within and between-participant variance for each measure was estimated using mixed-effects models. Intraclass correlation (ICC), SE of measurement and minimum detectable change (MDC) were reported. RESULTS:Average performance did not vary between baseline and repeat assessments in any test, except RCS. The rater significantly affected performance on all tests except one, but time of day did not. Reliability varied from ICC=0.66 (RCS) to ICC=0.88 (usual gait speed). MDC was 2.08?s for TUG, 4.52?s for RCS and ranged from 19.49 to 34.73 cm/s for walking speed tests. There was no evidence for lower reliability of gait parameters with increasing time between assessments. CONCLUSIONS:Reliability varied for each test when measurements are obtained over 1-4 months with most variation due to rater effects. Usual and motor dual task gait speed demonstrated highest reliability.

SUBMITTER: Donoghue OA

PROVIDER: S-EPMC6858113 | biostudies-literature | 2019 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reliability, measurement error and minimum detectable change in mobility measures: a cohort study of community-dwelling adults aged 50 years and over in Ireland.

Donoghue Orna A OA Savva George M GM Börsch-Supan Axel A Kenny Rose Anne RA

BMJ open 20191111 11

<h4>Objective</h4>To estimate the effects of repeat assessments, rater and time of day on mobility measures and to estimate their variation between and within participants in a population-based sample of Irish adults aged ≥50 years.<h4>Design</h4>Test-retest study in a population representative sample.<h4>Setting</h4>Academic health assessment centre of The Irish Longitudinal Study on Ageing (TILDA).<h4>Participants</h4>128 community-dwelling adults from the Survey for Health, Ageing and Retirem ...[more]

PMID: 31719075

Similar Datasets

Project description:The lack of standardized criteria for measuring therapeutic response is a major obstacle to the development of new therapeutic agents for chronic graft-versus-host disease (cGVHD). National Institutes of Health (NIH) consensus criteria for evaluating therapeutic response were published in 2006. We report the results of 4 consecutive pilot trials evaluating the feasibility and estimating the interrater reliability and minimum detectable change of these response criteria. Hematology-oncology clinicians with limited experience in applying the NIH cGVHD response criteria (n = 34) participated in a 2.5-hour training session on response evaluation in cGVHD. Feasibility and interrater reliability between subspecialty cGVHD experts and this panel of clinician raters were examined in a sample of 25 children and adults with cGVHD. The minimum detectable change was calculated using the standard error of measurement. Clinicians' impressions of the brief training session, the photo atlas, and the response criteria documentation tools were generally favorable. Performing and documenting the full set of response evaluations required a median of 21 minutes (range: 12-60 minutes) per rater. The Schirmer tear test required the greatest time of any single test (median: 9 minutes). Overall, interrater agreement for skin and oral manifestations was modest; however, in the third and fourth trials, the agreement between clinicians and experts for all dimensions except movable sclerosis approached satisfactory values. In the final 2 trials, the threshold for defining change exceeding measurement error was 19% to 22% body surface area (BSA) for erythema, 18% to 26% BSA for movable sclerosis, 17% to 21% BSA for nonmovable sclerosis, and 2.1 to 2.6 points on the 15-point NIH Oral cGHVD scale. Agreement between clinician-expert pairs was moderate to substantial for the measures of functional capacity and for the gastrointestinal and global cGVHD rating scales. These results suggest that the NIH response criteria are feasible for use, and these reliability estimates are encouraging, because they were observed following a single 2.5-hour training session given at multiple transplant centers, with no opportunity for iterative training and calibration. Research is needed to evaluate inter- and intrarater reliability in larger samples, and to evaluate these response criteria as predictors of outcomes in clinical trials.

Project description:BackgroundMobility is a key indicator of physical functioning in older people, but there is limited evidence of the reliability of mobility measures in older people with cognitive impairment. This study aimed to examine the test-retest reliability and measurement error of common measurement instruments of mobility and physical functioning in older patients with dementia, delirium or other cognitive impairment.MethodsA cross-sectional study was performed in a geriatric hospital. Older acute medical patients with cognitive impairment, indicated by a Mini-Mental State Examination (MMSE) score of ?24 points, were assessed twice within 1 day by a trained physiotherapist. The following instruments were applied: de Morton Mobility Index, Hierarchical Assessment of Balance and Mobility, Performance-Oriented Mobility Assessment, Short Physical Performance Battery, 4-m gait speed, 5-times chair rise test, 2-min walk test, timed up and go test, Barthel Index mobility subscale and Functional Ambulation Categories. As appropriate, the intraclass correlation coefficient (ICC), Cohen's kappa, standard error of measurement, limits of agreement and minimal detectable change (MDC) values were estimated.ResultsSixty-five older acute medical patients with cognitive impairment participated in the study (mean age: 82?±?7?years; mean MMSE: 20?±?4, range: 10 to 24 points). Some participants were physically or cognitively unable to perform the gait speed (46%), 2-min walk (46%), timed up and go (51%) and chair rise (75%) tests. ICC and kappa values were above 0.9 in all instruments except for the gait speed (ICC?=?0.86) and chair rise (ICC?=?0.72) measures. Measurement error is reported for each instrument. The absolute limits of agreement ranged from 11% (de Morton Mobility Index and Hierarchical Assessment of Balance and Mobility) to 35% (chair rise test).ConclusionsThe test-retest reliability is sufficient (>?0.7) for group-comparisons in all examined instruments. Most mobility measurements have limited use for individual monitoring of mobility over time in older hospital patients with cognitive impairment because of the large measurement error (>?20% of scale width), even though relative reliability estimations seem sufficient (>?0.9) for this purpose.Trial registrationGerman Clinical Trials Register ( DRKS00005591 ). Registered 2 February 2015.

Project description:Motor learning studies face the challenge of differentiating between real changes in performance and random measurement error. While the traditional p-value-based analyses of difference (e.g., t-tests, ANOVAs) provide information on the statistical significance of a reported change in performance scores, they do not inform as to the likely cause or origin of that change, that is, the contribution of both real modifications in performance and random measurement error to the reported change. One way of differentiating between real change and random measurement error is through the utilization of the statistics of standard error of measurement (SEM) and minimal detectable change (MDC). SEM is estimated from the standard deviation of a sample of scores at baseline and a test-retest reliability index of the measurement instrument or test employed. MDC, in turn, is estimated from SEM and a degree of confidence, usually 95%. The MDC value might be regarded as the minimum amount of change that needs to be observed for it to be considered a real change, or a change to which the contribution of real modifications in performance is likely to be greater than that of random measurement error. A computer-based motor task was designed to illustrate the applicability of SEM and MDC to motor learning research. Two studies were conducted with healthy participants. Study 1 assessed the test-retest reliability of the task and Study 2 consisted in a typical motor learning study, where participants practiced the task for five consecutive days. In Study 2, the data were analyzed with a traditional p-value-based analysis of difference (ANOVA) and also with SEM and MDC. The findings showed good test-retest reliability for the task and that the p-value-based analysis alone identified statistically significant improvements in performance over time even when the observed changes could in fact have been smaller than the MDC and thereby caused mostly by random measurement error, as opposed to by learning. We suggest therefore that motor learning studies could complement their p-value-based analyses of difference with statistics such as SEM and MDC in order to inform as to the likely cause or origin of any reported changes in performance.

Project description:BackgroundNeck pain is one of the leading causes of years lived with disability, and approximately half of people with neck pain experience recurrent episodes. Deficits in the sensorimotor system can persist even after pain relief, which may contribute to the chronic course of neck pain in some patients. Evaluation of sensorimotor capacities in patients with neck pain is therefore important. No consensus exists on how sensorimotor capacities of the neck should be assessed in physiotherapy. The aims of this systematic review are: (a) to provide an overview of tests used in physiotherapy for assessment of sensorimotor capacities in patients with neck pain; and (b) to provide information about reliability and measurement error of these tests, to enable physiotherapists to select appropriate tests.MethodsMedline, CINAHL, Embase and PsycINFO databases were searched for studies reporting data on the reliability and/or measurement error of sensorimotor tests in patients with neck pain. The results for reliability and measurement error were compared against the criteria for good measurement properties. The quality of evidence was assessed according to the modified GRADE method proposed by the COSMIN group.ResultsA total of 206 tests for assessment of sensorimotor capacities of the neck were identified and categorized into 18 groups of tests. The included tests did not cover all aspects of the sensorimotor system; tests for the sensory and motor components were identified, but not for the central integration component. Furthermore, no data were found on reliability or measurement error for some tests that are used in practice, such as movement control tests, which apply to the motor component. Approximately half of the tests showed good reliability, and 12 were rated as having good (+) reliability. However, tests that evaluated complex movements, which are more difficult to standardize, were less reliable. Measurement error could not be evaluated because the minimal clinically important change was not available for all tests.ConclusionOverall, the quality of evidence is not yet high enough to enable clear recommendations about which tests to use to assess the sensorimotor capacities of the neck.

Dataset Information

Reliability, measurement error and minimum detectable change in mobility measures: a cohort study of community-dwelling adults aged 50 years and over in Ireland.

Publications

Reliability, measurement error and minimum detectable change in mobility measures: a cohort study of community-dwelling adults aged 50 years and over in Ireland.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets