Dataset Information

The Applicability of Standard Error of Measurement and Minimal Detectable Change to Motor Learning Research-A Behavioral Study.

ABSTRACT: Motor learning studies face the challenge of differentiating between real changes in performance and random measurement error. While the traditional p-value-based analyses of difference (e.g., t-tests, ANOVAs) provide information on the statistical significance of a reported change in performance scores, they do not inform as to the likely cause or origin of that change, that is, the contribution of both real modifications in performance and random measurement error to the reported change. One way of differentiating between real change and random measurement error is through the utilization of the statistics of standard error of measurement (SEM) and minimal detectable change (MDC). SEM is estimated from the standard deviation of a sample of scores at baseline and a test-retest reliability index of the measurement instrument or test employed. MDC, in turn, is estimated from SEM and a degree of confidence, usually 95%. The MDC value might be regarded as the minimum amount of change that needs to be observed for it to be considered a real change, or a change to which the contribution of real modifications in performance is likely to be greater than that of random measurement error. A computer-based motor task was designed to illustrate the applicability of SEM and MDC to motor learning research. Two studies were conducted with healthy participants. Study 1 assessed the test-retest reliability of the task and Study 2 consisted in a typical motor learning study, where participants practiced the task for five consecutive days. In Study 2, the data were analyzed with a traditional p-value-based analysis of difference (ANOVA) and also with SEM and MDC. The findings showed good test-retest reliability for the task and that the p-value-based analysis alone identified statistically significant improvements in performance over time even when the observed changes could in fact have been smaller than the MDC and thereby caused mostly by random measurement error, as opposed to by learning. We suggest therefore that motor learning studies could complement their p-value-based analyses of difference with statistics such as SEM and MDC in order to inform as to the likely cause or origin of any reported changes in performance.

SUBMITTER: Furlan L

PROVIDER: S-EPMC5875129 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The Applicability of Standard Error of Measurement and Minimal Detectable Change to Motor Learning Research-A Behavioral Study.

Furlan Leonardo L Sterr Annette A

Frontiers in human neuroscience 20180322

Motor learning studies face the challenge of differentiating between real changes in performance and random measurement error. While the traditional <i>p</i>-value-based analyses of difference (e.g., <i>t</i>-tests, ANOVAs) provide information on the statistical significance of a reported change in performance scores, they do not inform as to the likely cause or origin of that change, that is, the contribution of both real modifications in performance and random measurement error to the reported ...[more]

PMID: 29623034

Similar Datasets

Project description:BackgroundTracking gait and balance impairment in time is paramount in the care of older neurological patients. The Minimal Detectable Change (MDC), built upon the Standard Error of the Measurement (SEM), is the smallest modification of a measure exceeding the measurement error. Here, a novel method based on linear mixed-effects models (LMMs) is applied to estimate the standard error of the measurement from data collected before and after rehabilitation and calculate the MDC of gait and balance measures.MethodsOne hundred nine older adults with a gait impairment due to neurological disease (66 stroke patients) completed two assessment sessions before and after inpatient rehabilitation. In each session, two trials of the 10-meter walking test and the Timed Up and Go (TUG) test, instrumented with inertial sensors, have been collected. The 95% MDC was calculated for the gait speed, TUG test duration (TTD) and other measures from the TUG test, including the angular velocity peak (ωpeak) in the TUG test's turning phase. Random intercepts and slopes LMMs with sessions as fixed effects were used to estimate SEM. LMMs assumptions (residuals normality and homoscedasticity) were checked, and the predictor variable ln-transformed if needed.ResultsThe MDC of gait speed was 0.13 m/s. The TTD MDC, ln-transformed and then expressed as a percentage of the baseline value to meet LMMs' assumptions, was 15%, i.e. TTD should be < 85% of the baseline value to conclude the patient's improvement. ωpeak MDC, also ln-transformed and expressed as the baseline percentage change, was 25%.ConclusionsLMMs allowed calculating the MDC of gait and balance measures even if the test-retest steady-state assumption did not hold. The MDC of gait speed, TTD and ωpeak from the TUG test with an inertial sensor have been provided. These indices allow monitoring of the gait and balance impairment, which is central for patients with an increased falling risk, such as neurological old persons.Trial registrationNA.

Project description:BackgroundThe Cognitive Abilities Screening Instrument (CASI) is widely used to assess global cognitive function in patients with dementia. It contains nine cognitive domains, namely long-term memory, short-term memory, attention, mental manipulation, orientation, abstraction and judgment, language, visual construction, and list-generating fluency. However, test-retest reliability and minimal detectable change (MDC) of the CASI are largely unknown in patients with dementia, which limits its utility and the explanation of a score change.PurposeThe purpose of this study was to examine test-retest reliability and calculate MDC of the CASI in patients with dementia.MethodsFifty-two patients with dementia completed the CASI twice with a two-week interval. The frequencies of the scores in the Clinical Dementia Rating (0.5, 1, and ≥ 2) were 38.5, 36.5, and 25.0, respectively. Test-retest reliability was examined using intraclass correlation coefficient (ICC) for the total score and nine domains of the CASI. The MDC was calculated based on standard error of measurement.ResultsThe ICC value of the CASI total score was 0.97 while the ICC value for the nine domains were 0.65-0.92. The MDC values (MDC%) were 11.6 (12.9%), 2.8 (23.2%), 4.5 (41.2%), 3.4 (42.1%), 4.9 (49.2%), 5.3 (29.2%), 3.4 (28.8%), 2.2 (22.3%), 3.2 (32.1%), and 3.1 (30.7%) for CASI total score, long-term memory, short-term memory, attention, mental manipulation, orientation, abstraction and judgment, language, visual construction, and list-generating fluency, respectively.ConclusionOur results revealed that the CASI has sufficient test-retest reliability. The MDC values are useful in determining a real change (i.e., improvement or deterioration) between two assessments of an individual patient. However, four domains (i.e., short-term memory, attention, mental manipulation, and list-generating fluency) demonstrated lower ICC values and substantial random measurement errors. Clinicians and researchers should be cautious while using these four domains to explain score changes between repeated assessments of patients with dementia.

Dataset Information

The Applicability of Standard Error of Measurement and Minimal Detectable Change to Motor Learning Research-A Behavioral Study.

Publications

The Applicability of Standard Error of Measurement and Minimal Detectable Change to Motor Learning Research-A Behavioral Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets