Dataset Information

Using cognitive pretesting in scale development for Parkinson's disease: the Movement Disorder Society Unified Parkinson's Disease Rating Scale (MDS-UPDRS) example.

ABSTRACT: Cognitive pretesting, a qualitative step in scale development, precedes field testing and assesses the difficulty of instrument completion for examiners and respondents. Cognitive pretesting assesses respondent interest, attention span, discomfort, and comprehension, and highlights problems with the logical structure of questions/response options that can affect understanding. In the past this approach was not consistently used in the development or revision of movement disorders scales.We applied qualitative cognitive pretesting using testing guides in development of the Movement Disorder Society-sponsored revision of the Unified Parkinson's Disease Rating Scale (MDS-UPDRS). The guides were based on qualitative techniques, verbal probing and "think-aloud" interviewing, to identify problems with the scale from the patient and rater perspectives. English-speaking Parkinson's disease patients and movement disorders specialists (raters) from multiple specialty clinics in the United States, Western Europe and Canada used the MDS-UPDRS and completed the testing guides.Two rounds of cognitive pretesting were necessary before proceeding to field testing of the revised scale to assess clinimetric properties. Scale revisions based on cognitive pretesting included changes in phrasing, simplification of some questions, and addition of a reassuring statement explaining that not all PD patients experience the symptoms described in the questions.The strategy of incorporating cognitive pretesting into scale development and revision provides a model for other movement disorders scales. Cognitive pretesting is being used in translating the MDS-UPDRS into multiple languages to improve comprehension and acceptance and in the development of a new Unified Dyskinesia Rating Scale for Parkinson's disease patients.

SUBMITTER: Tilley BC

PROVIDER: S-EPMC5086096 | biostudies-literature | 2014

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Using cognitive pretesting in scale development for Parkinson's disease: the Movement Disorder Society Unified Parkinson's Disease Rating Scale (MDS-UPDRS) example.

Tilley Barbara C BC LaPelle Nancy R NR Goetz Christopher G CG Stebbins Glenn T GT

Journal of Parkinson's disease 20140101 3

<h4>Background</h4>Cognitive pretesting, a qualitative step in scale development, precedes field testing and assesses the difficulty of instrument completion for examiners and respondents. Cognitive pretesting assesses respondent interest, attention span, discomfort, and comprehension, and highlights problems with the logical structure of questions/response options that can affect understanding. In the past this approach was not consistently used in the development or revision of movement disord ...[more]

PMID: 24613868

Similar Datasets

Project description:BackgroundTelemedicine has become standard in clinical care and research during the coronavirus disease 2019 pandemic. Remote administration of Movement Disorder Society Unified Parkinson's Disease Rating Scale (MDS-UPDRS) Part III (Motor Examination) precludes ratings of all items, because Rigidity and Postural Stability (six scores) require in-person rating.ObjectiveThe objective of this study was to determine imputation accuracy for total-sum and item-specific MDS-UPDRS Motor Examination scores in remote administration.MethodsWe applied multivariate imputation by chained equations techniques in a cross-sectional dataset where patients had one MDS-UPDRS rating (International Translational Program, n = 8,588) and in a longitudinal dataset where patients had multiple ratings (Rush Program, n = 396). Successful imputation was stringently defined as (1) generalized Lin's concordance correlation coefficient >0.95, reflecting near-perfect agreement between total-sum score with complete data and surrogate score, calculated without patients' actual Rigidity and Postural Stability scores; and (2) perfect agreement for item-level scores for Rigidity and Postural Stability items.ResultsFor total-sum score when Rigidity and Postural Stability scores were withdrawn, using one or multiple visits, multivariate imputation by chained equations imputation reached near-perfect agreement with the original total-sum score. However, at the item level, the degree of perfect agreement between the surrogate and actual Rigidity items and Postural Stability scores always fell below threshold.ConclusionsThe MDS-UPDRS Part III total-sum score, a key clinical outcome in research and in clinical practice, can be accurately imputed without the Rigidity and Postural Stability items that cannot be rated by telemedicine. No formula, however, allows for specific item-level imputation. When Rigidity and Postural Stability item scores are of key clinical or research interest, patients with PD must be scored in person. © 2022 International Parkinson and Movement Disorder Society.

Project description:BackgroundAlthough nontremor and tremor Part 3 Movement Disorder Society-Unified Parkinson's Disease Rating Scale items measure different impairment domains, their distinct progression and drug responsivity remain unstudied longitudinally. The total score may obscure important time-based and treatment-based changes occurring in the individual domains.ObjectiveUsing the unique advantages of item response theory (IRT), we developed novel longitudinal unidimensional and multidimensional models to investigate nontremor and tremor changes occurring in an interventional Parkinson's disease (PD) study.MethodWith unidimensional longitudinal IRT, we assessed the 33 Part 3 item data (22 nontremor and 10 tremor items) of 336 patients with early PD from the STEADY-PD III (Safety, Tolerability, and Efficacy Assessment of Isradipine for PD, placebo vs. isradipine) study. With multidimensional longitudinal IRT, we assessed the progression rates over time and treatment (in overall motor severity, nontremor, and tremor domains) using Markov Chain Monte Carlo implemented in Stan.ResultsRegardless of treatment, patients showed significant but different time-based deterioration rates for total motor, nontremor, and tremor scores. Isradipine was associated with additional significant deterioration over placebo in total score and nontremor scores, but not in tremor score. Further highlighting the 2 separate latent domains, nontremor and tremor severity changes were positively but weakly correlated (correlation coefficient, 0.108).ConclusionsLongitudinal IRT analysis is a novel statistical method highly applicable to PD clinical trials. It addresses limitations of traditional linear regression approaches and previous IRT investigations that either applied cross-sectional IRT models to longitudinal data or failed to estimate all parameters simultaneously. It is particularly useful because it can separate nontremor and tremor changes both over time and in response to treatment interventions.

Dataset Information

Using cognitive pretesting in scale development for Parkinson's disease: the Movement Disorder Society Unified Parkinson's Disease Rating Scale (MDS-UPDRS) example.

Publications

Using cognitive pretesting in scale development for Parkinson's disease: the Movement Disorder Society Unified Parkinson's Disease Rating Scale (MDS-UPDRS) example.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets