Dataset Information

A Novel, Integrative Approach for Evaluating Progression in Multiple Sclerosis: Development of a Scoring Algorithm.

ABSTRACT: BACKGROUND:There is an unmet need for a tool that helps to evaluate patients who are at risk of progressing from relapsing-remitting multiple sclerosis to secondary progressive multiple sclerosis (SPMS). A new tool supporting the evaluation of early signs suggestive of progression in multiple sclerosis (MS) has been developed. In the initial stage, concepts relevant to progression were identified using a mixed method approach involving regression on data from a real-world observational study and qualitative research with patients and physicians. The tool was drafted in a questionnaire format to assess these variables. OBJECTIVE:This study aimed to develop the scoring algorithm for the tool, using both quantitative and qualitative research methods. METHODS:The draft scoring algorithm was developed using two approaches: quantitative analysis of real-world data and qualitative analysis based on physician interviews and ranking and weighting exercises. Variables that were included in the draft tool and regarded as most clinically relevant were selected for inclusion in a multiple logistic regression. The analyses were run using physician-reported data and patient-reported data. Subsequently, a ranking and weighting exercise was conducted with 8 experienced neurologists as part of semistructured interviews. Physicians were presented with the variables included in the draft tool and were asked to rank them in order of strength of contribution to progression and assign a weight by providing a percentage of the overall contribution. Physicians were also asked to explain their ranking and weighting choices. Concordance between physicians was explored. RESULTS:Multiple logistic regression identified age, MS disease activity, and Expanded Disability Status Scale score as the most significant physician-reported predictors of progression to SPMS. Patient age, mobility, and self-care were identified as the strongest patient-reported predictors of progression to SPMS. In physician interviews, the variables ranked and weighted as most important were stability or worsening of symptoms, intermittent or persistent symptoms, and presence of ambulatory and cognitive symptoms. Across all physicians, the level of concordance was 0.278 (P<.001), indicating a low to moderate, but statistically significant, level of agreement. Variables were categorized as high (n=8), moderate (n=8), or low (n=10) importance based on the findings from the different approaches described above. Accordingly, the respective questions in the tool were assigned a weight of "three," "two," or "one" to inform the draft scoring algorithm. CONCLUSIONS:This study further confirms the need for a tool to provide a consistent, comprehensive approach across physicians to support the early evaluation of signs indicative of progression to SPMS. The novel and comprehensive approach to develop the draft scoring algorithm triangulates data obtained from ranking and weighting exercises, qualitative interviews, and a real-world observational study. Variables that go beyond the clinically most obvious impairment in lower limbs have been identified as relevant subtle/sensitive signs suggestive of progressive disease.

SUBMITTER: Tolley C

PROVIDER: S-EPMC7189255 | biostudies-literature | 2020 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Novel, Integrative Approach for Evaluating Progression in Multiple Sclerosis: Development of a Scoring Algorithm.

Tolley Chloe C Piani-Meier Daniela D Bentley Sarah S Bennett Bryan B Jones Eddie E Pike James J Dahlke Frank F Tomic Davorka D Ziemssen Tjalf T

JMIR medical informatics 20200414 4

<h4>Background</h4>There is an unmet need for a tool that helps to evaluate patients who are at risk of progressing from relapsing-remitting multiple sclerosis to secondary progressive multiple sclerosis (SPMS). A new tool supporting the evaluation of early signs suggestive of progression in multiple sclerosis (MS) has been developed. In the initial stage, concepts relevant to progression were identified using a mixed method approach involving regression on data from a real-world observational s ...[more]

PMID: 32286236

Similar Datasets

Project description:BACKGROUND:Defining the transition from relapsing-remitting multiple sclerosis (RRMS) to secondary progressive multiple sclerosis (SPMS) can be challenging and delayed. A digital tool (MSProDiscuss) was developed to facilitate physician-patient discussion in evaluating early, subtle signs of multiple sclerosis (MS) disease progression representing this transition. OBJECTIVE:This study aimed to determine cut-off values and corresponding sensitivity and specificity for predefined scoring algorithms, with or without including Expanded Disability Status Scale (EDSS) scores, to differentiate between RRMS and SPMS patients and to evaluate psychometric properties. METHODS:Experienced neurologists completed the tool for patients with confirmed RRMS or SPMS and those suspected to be transitioning to SPMS. In addition to age and EDSS score, each patient's current disease status (disease activity, symptoms, and its impacts on daily life) was collected while completing the draft tool. Receiver operating characteristic (ROC) curves determined optimal cut-off values (sensitivity and specificity) for the classification of RRMS and SPMS. RESULTS:Twenty neurologists completed the draft tool for 198 patients. Mean scores for patients with RRMS (n=89), transitioning to SPMS (n=47), and SPMS (n=62) were 38.1 (SD 12.5), 55.2 (SD 11.1), and 69.6 (SD 12.0), respectively (P<.001, each between-groups comparison). Area under the ROC curve (AUC) including and excluding EDSS were for RRMS (including) AUC 0.91, 95% CI 0.87-0.95, RRMS (excluding) AUC 0.88, 95% CI 0.84-0.93, SPMS (including) AUC 0.91, 95% CI 0.86-0.95, and SPMS (excluding) AUC 0.86, 95% CI 0.81-0.91. In the algorithm with EDSS, the optimal cut-off values were ?51.6 for RRMS patients (sensitivity=0.83; specificity=0.82) and ?58.9 for SPMS patients (sensitivity=0.82; specificity=0.84). The optimal cut-offs without EDSS were ?46.3 and ?57.8 and resulted in similar high sensitivity and specificity (0.76-0.86). The draft tool showed excellent interrater reliability (intraclass correlation coefficient=.95). CONCLUSIONS:The MSProDiscuss tool differentiated RRMS patients from SPMS patients with high sensitivity and specificity. In clinical practice, it may be a useful tool to evaluate early, subtle signs of MS disease progression indicating the evolution of RRMS to SPMS. MSProDiscuss will help assess the current level of progression in an individual patient and facilitate a more informed physician-patient discussion.

Project description:Objective: We developed and internally validated an algorithm for disability status in multiple sclerosis (MS) using administrative data. Methods: We linked administrative data from Manitoba, Canada to a clinical dataset with Expanded Disability Status Scale (EDSS) scores for people with MS. Clinical EDSS scores constituted the reference standard. We created candidate indicators using the administrative data. These included indicators based on use of particular health care services (home care, long-term care, rehabilitation admission), use of specific diagnostic codes (such as spasticity, quadriplegia), and codes based on use of Employment and Income Insurance. We developed algorithms to predict severe disability (EDSS ≥6.0), and to predict disability as a continuous measure. We manually developed algorithms, and also employed regression approaches. After we selected our preferred algorithms for disability, we tested their association with health care use due to any cause and infection after potential confounders. Results: We linked clinical and administrative data for 1,767 persons with MS, most of whom were women living in urban areas. All individual indicators tested had specificities >90% for severe disability, and all but a diagnosis of visual disturbance had positive predictive values (PPV) >70%. The combination of home care or long-term care use or rehabilitation admission had a sensitivity of 61.9%, specificity of 90.76%, PPV of 70.06% and negative predictive of 87.21%. Based on regression modeling, the best-performing algorithm for predicting the EDSS as a continuous variable included age, home care use, long-term care admission, admission for rehabilitation, visual disturbance, other paralytic syndromes and spasticity. The mean difference between observed and predicted values of the EDSS was -0.0644 (95%CI -0.1632, 0.0304). Greater disability, whether measured using the clinical EDSS or either of the administrative data algorithms was similarly associated with increased hospitalization rates due to any cause and infection. Conclusion: We developed and internally validated an algorithm for disability in MS using administrative data that may support population-based studies that wish to account for disability status but do not have access to clinical data sources with this information. We also found that more severe disability is associated with increased health care use, including due to infection.

Dataset Information

A Novel, Integrative Approach for Evaluating Progression in Multiple Sclerosis: Development of a Scoring Algorithm.

Publications

A Novel, Integrative Approach for Evaluating Progression in Multiple Sclerosis: Development of a Scoring Algorithm.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets