Dataset Information

Test-retest reliability and minimal detectable change of the Cognitive Abilities Screening Instrument in patients with dementia.

ABSTRACT:

Background

The Cognitive Abilities Screening Instrument (CASI) is widely used to assess global cognitive function in patients with dementia. It contains nine cognitive domains, namely long-term memory, short-term memory, attention, mental manipulation, orientation, abstraction and judgment, language, visual construction, and list-generating fluency. However, test-retest reliability and minimal detectable change (MDC) of the CASI are largely unknown in patients with dementia, which limits its utility and the explanation of a score change.

Purpose

The purpose of this study was to examine test-retest reliability and calculate MDC of the CASI in patients with dementia.

Methods

Fifty-two patients with dementia completed the CASI twice with a two-week interval. The frequencies of the scores in the Clinical Dementia Rating (0.5, 1, and ≥ 2) were 38.5, 36.5, and 25.0, respectively. Test-retest reliability was examined using intraclass correlation coefficient (ICC) for the total score and nine domains of the CASI. The MDC was calculated based on standard error of measurement.

Results

The ICC value of the CASI total score was 0.97 while the ICC value for the nine domains were 0.65-0.92. The MDC values (MDC%) were 11.6 (12.9%), 2.8 (23.2%), 4.5 (41.2%), 3.4 (42.1%), 4.9 (49.2%), 5.3 (29.2%), 3.4 (28.8%), 2.2 (22.3%), 3.2 (32.1%), and 3.1 (30.7%) for CASI total score, long-term memory, short-term memory, attention, mental manipulation, orientation, abstraction and judgment, language, visual construction, and list-generating fluency, respectively.

Conclusion

Our results revealed that the CASI has sufficient test-retest reliability. The MDC values are useful in determining a real change (i.e., improvement or deterioration) between two assessments of an individual patient. However, four domains (i.e., short-term memory, attention, mental manipulation, and list-generating fluency) demonstrated lower ICC values and substantial random measurement errors. Clinicians and researchers should be cautious while using these four domains to explain score changes between repeated assessments of patients with dementia.

SUBMITTER: Chiu EC

PROVIDER: S-EPMC6504091 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:The ability to detect one's own memory capacity and develop strategies based on daily contexts is important for daily activities. The Contextual Memory Test (CMT) assesses self-awareness, self-efficacy, self-perception/evaluation of performance, recall, and strategy use that are associated with daily contexts, and could be a potentially suitable measurement for assessing memory and meta-memory in older adults with and without cognitive impairment. Nevertheless, the test-retest reliability and minimal detectable change (MDC) remain unknown in these individuals. OBJECTIVE:The purpose of this study was to examine test-retest reliability and calculate MDC of the CMT in healthy older adults and those with mild cognitive impairment (MCI). METHODS:Eighty-three participants completed the CMT twice with a one-month interval. Test-retest reliability was examined using intraclass correlation coefficient (ICC) in all seven domains of the CMT and the recognition subtest. The standard error of measurement (SEM) and MDC were calculated. The Bland-Altman analysis was performed to evaluate the degree of agreement between measurements. RESULTS:The ICC of five domains (self-awareness, self-perception/evaluation of performance, immediate/delayed/total recall) and the recognition subtest were good to excellent (ICC = 0.63-0.94) in healthy and MCI participants and the MDC% were less than 30% The ICC of the other two domains (self-efficacy and total strategy use, TSS) were low (ICC = 0.07-0.59) and the MDC% exceeded 30%. The Bland-Altman analysis showed generally better performance in the 2nd than the 1st measurement in most CMT domains. CONCLUSIONS:Our results revealed sufficient test-retest reliability and acceptable MDC in most CMT domains in healthy and MCI participants. Only the self-efficacy and TSS domains demonstrated low ICC and large MDC. Possible practice effects were found between repeated measurements. Clinicians should be cautious when evaluating self-efficacy and strategy use using the CMT in older adults. Further improvements are needed for these two domains.

Project description:Background Although knee extensors are essential in daily activities (e.g. walking, climbing stairs), knee extensor strength is often not measured in clinical settings. Existing devices to test muscle strength are not always suitable to accurately measure the high forces of this muscle group. Therefore, a device to test muscle strength that is convenient, feasible, reliable, and valid in clinical settings is required. This study evaluated the reliability, responsiveness, and level of discomfort of the newly developed Q-Force ӀӀ (i.e. a portable device to measure isometric knee extensor strength) in healthy middle-aged and elderly adults. Methods Participants (n = 22) conducted two standardized test sessions on the Q-Force ӀӀ (five to ten days apart). Each session consisted of one familiarisation trial followed by three trials of peak isometric knee extension per each leg. Per trial, peak and mean knee extension force (N) and torque (Nm) were measured at 90° flexion. The level of discomfort was determined using a visual analog scale (VAS: 0-100). Intra Class Correlation (ICC, model: two-way mixed with absolute agreement), Standard Error of Measurement (SEM), and minimal detectable change (MDC) were determined. A repeated measures ANOVA was used to determine between-test variation. Results Excellent test-retest (ICC > 0.95) and inter-trial (ICC > 0.91) reliability for both legs were shown. No significant differences were found in peak and mean knee forces and torques between test and retest of both legs, indicating good test-retest reliability (P-value range: 0.360-0.538; F(1,21) range: 0.4-0.9). The SEM of the peak and mean forces and torques ranged from 28.0 to 30.4 N (6.0-6.8%) and from 9.2 to 10.4 Nm (6.4-7.7%), respectively. The MDC for these outcomes ranged respectively from 77.6 to 84.1 N (16.5-18.8%) and from 25.5 to 28.9 Nm (17.6-21.4%). The level of discomfort was low (median range: 7-10, IQR: 4-18). Conclusion The portable Q-Force ӀӀ is a comfortable, responsive, and relatively cheap device with excellent test-retest reliability. This device would be potentially suitable to measure isometric knee extensor strength in clinical settings. Supplementary Information The online version contains supplementary material available at 10.1186/s12891-021-04848-8.