Dataset Information

Psychometric properties of the Need for Recovery after work scale: test-retest reliability and sensitivity to detect change.

ABSTRACT: BACKGROUND: Monitoring worker health and evaluating occupational healthcare interventions requires sensitive instruments that are reliable over time. The Need for Recovery scale (NFR), which quantifies workers' difficulties in recovering from work related exertions, may be a relevant instrument in this respect. OBJECTIVES: To examine (1) the NFR's test-retest reliability and (2) the NFR's sensitivity to detect the effect of a fatigue inducing change, namely an increase in working hours. METHODS: Two year longitudinal data of 526 truck drivers and 144 nurses were used. Two week, one year, and two year test-retest reliability was examined in both stable and unstable work environments by calculating intraclass correlations (ICCs). Work environmental (in)stability was quantified by four events that might have occurred during the follow up period: (1) a reorganisation or merge (0 = yes, 1 = no), (2) a change of supervisor or management (0 = yes, 1 = no), (3) a change in working hours or work schedules (0 = yes, 1 = no), and (4) a change in work activities, position, or duties (0 = yes, 1 = no). The four scores constituted a work (in)stability index ranging from 0 to 4. The NFR's sensitivity to detect the effect of the increase in working hours was assessed indirectly by comparing it with an alternative scale, namely the Checklist Individual Strength. RESULTS: Test-retest reliability over a two year interval was good to excellent when applied in stable work environments (ICCs 0.68 to 0.80) but, as expected, poor to fair when applied in unstable work environments (ICCs 0.30 to 0.55). The NFR was sensitive in detecting an increase in work related fatigue due to the increase in working hours (effect size 0.40). CONCLUSIONS: The NFR's test-retest reliability and sensitivity to detect change are favourable. This implicates that the NFR may form a valuable part of health surveys and may be a useful tool for evaluating occupational healthcare interventions.

SUBMITTER: de Croon EM

PROVIDER: S-EPMC2078147 | biostudies-literature | 2006 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Psychometric properties of the Need for Recovery after work scale: test-retest reliability and sensitivity to detect change.

de Croon E M EM Sluiter J K JK Frings-Dresen M H W MH

Occupational and environmental medicine 20060301 3

<h4>Background</h4>Monitoring worker health and evaluating occupational healthcare interventions requires sensitive instruments that are reliable over time. The Need for Recovery scale (NFR), which quantifies workers' difficulties in recovering from work related exertions, may be a relevant instrument in this respect.<h4>Objectives</h4>To examine (1) the NFR's test-retest reliability and (2) the NFR's sensitivity to detect the effect of a fatigue inducing change, namely an increase in working ho ...[more]

PMID: 16497863

Similar Datasets

Project description:The 20-meter walk test is a physical function measure commonly used in clinical research studies and rehabilitation clinics to measure gait speed and monitor changes in patients' physical function over time. Unfortunately, the reliability and sensitivity of this walk test are not well defined and, therefore, limit our ability to evaluate real changes in gait speed not attributable to normal variability. The aim of this study was to assess the test-restest reliability and sensitivity of the 20-meter walk test, at a self-selected pace, among patients with mild to moderate knee osteoarthritis (OA) and to suggest a standardized protocol for future test administration.This was a measurement reliability study. Fifteen consecutive people enrolled in a randomized-controlled trial of intra-articular corticosteroid injections for knee OA participated in this study. All participants completed 4 trials on 2 separate days, 7 to 21 days apart (8 trials total). Each day was divided into 2 sessions, which each involved 2 walking trials. We compared walk times between trials with Wilcoxon signed-rank tests. Similar analyses compared average walk times between sessions. To confirm these analyses, we also calculated Spearman correlation coefficients to assess the relationship between sessions. Finally, smallest detectable differences (SDD) were calculated to estimate the sensitivity of the 20-meter walk test.Wilcoxon signed-rank tests between trials within the same session demonstrated that trials in session 1 were significantly different and in the subsequent 3 sessions, the median differences between trials were not significantly different. Therefore, the first session of each day was considered a practice session, and the SDD between the second session of each day were calculated. SDD was -1.59 seconds (walking slower) and 0.15 seconds (walking faster).Practice trials and a standardized protocol should be used in administration of the 20-meter walk test. Changes in walk time between -1.59 seconds (walking slower) and 0.15 seconds (walking faster) should be considered within the range of normal variability of 20-meter walking speed. The primary limitation of our study was a small sample size, which may influence the generalizability of our findings.

Project description:BackgroundNeurocognitive testing is an important concussion evaluation tool, but for neurocognitive tests to be useful, their psychometric properties must be well established. Test-retest reliability of computerized neurocognitive tests can influence their clinical utility. The reliability for a commonly used computerized neurocognitive test, CNS Vital Signs, is not well established. The purpose of this study was to examine test-retest reliability and reliable change indices for CNS Vital Signs in a healthy, physically active college population.HypothesisCNS Vital Signs yields acceptable test-retest reliability, with greater reliability between the second and third test administration compared with between the first and second administration.Study designCohort study.Level of evidenceLevel 3.MethodsForty healthy, active volunteers (16 men, 24 women; mean age, 21.05 ± 2.17 years) reported to a clinical laboratory for 3 sessions, 1 week apart. At each session, participants were administered CNS Vital Signs. Outcomes included standard scores for the following CNS Vital Signs domains: verbal memory, visual memory, psychomotor speed, cognitive flexibility, complex attention, processing speed, reaction time, executive functioning, and reasoning.ResultsParticipants performed significantly better on the second session and/or third session than they did on the first testing session on 6 of 9 neurocognitive domains. Pearson r test-retest correlations between sessions ranged from 0.11 to 0.87. Intraclass correlation coefficients ranged from 0.10 to 0.86.ConclusionClinicians should consider using reliable change indices to account for practice effects, identify meaningful score changes due to pathology, and inform clinical decisions.Clinical relevanceThis study highlights the importance of clinicians understanding the psychometric properties of computerized neurocognitive tests when using them in the management of sport-related concussion. If CNS Vital Signs is administered twice within a small time frame (such as 1 week), athletes should be expected to improve between the first and second administration.

Project description:BackgroundThe Cognitive Abilities Screening Instrument (CASI) is widely used to assess global cognitive function in patients with dementia. It contains nine cognitive domains, namely long-term memory, short-term memory, attention, mental manipulation, orientation, abstraction and judgment, language, visual construction, and list-generating fluency. However, test-retest reliability and minimal detectable change (MDC) of the CASI are largely unknown in patients with dementia, which limits its utility and the explanation of a score change.PurposeThe purpose of this study was to examine test-retest reliability and calculate MDC of the CASI in patients with dementia.MethodsFifty-two patients with dementia completed the CASI twice with a two-week interval. The frequencies of the scores in the Clinical Dementia Rating (0.5, 1, and ≥ 2) were 38.5, 36.5, and 25.0, respectively. Test-retest reliability was examined using intraclass correlation coefficient (ICC) for the total score and nine domains of the CASI. The MDC was calculated based on standard error of measurement.ResultsThe ICC value of the CASI total score was 0.97 while the ICC value for the nine domains were 0.65-0.92. The MDC values (MDC%) were 11.6 (12.9%), 2.8 (23.2%), 4.5 (41.2%), 3.4 (42.1%), 4.9 (49.2%), 5.3 (29.2%), 3.4 (28.8%), 2.2 (22.3%), 3.2 (32.1%), and 3.1 (30.7%) for CASI total score, long-term memory, short-term memory, attention, mental manipulation, orientation, abstraction and judgment, language, visual construction, and list-generating fluency, respectively.ConclusionOur results revealed that the CASI has sufficient test-retest reliability. The MDC values are useful in determining a real change (i.e., improvement or deterioration) between two assessments of an individual patient. However, four domains (i.e., short-term memory, attention, mental manipulation, and list-generating fluency) demonstrated lower ICC values and substantial random measurement errors. Clinicians and researchers should be cautious while using these four domains to explain score changes between repeated assessments of patients with dementia.

Dataset Information

Psychometric properties of the Need for Recovery after work scale: test-retest reliability and sensitivity to detect change.

Publications

Psychometric properties of the Need for Recovery after work scale: test-retest reliability and sensitivity to detect change.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets