Dataset Information

Inter-method reliability of the modified Rankin Scale in patients with subarachnoid hemorrhage

ABSTRACT:

Background and objectives

The modified Rankin Scale (mRS) is one of the most frequently used outcome measures in trials in patients with an aneurysmal subarachnoid hemorrhage (aSAH). The assessment method of the mRS is often not clearly described in trials, while the method used might influence the mRS score. The aim of this study is to evaluate the inter-method reliability of different assessment methods of the mRS.

Methods

This is a prospective, randomized, multicenter study with follow-up at 6 weeks and 6 months. Patients aged ≥ 18 years with aSAH were randomized to either a structured interview or a self-assessment of the mRS. Patients were seen by a physician who assigned an mRS score, followed by either the structured interview or the self-assessment. Inter-method reliability was assessed with the quadratic weighted kappa score and percentage of agreement. Assessment of feasibility of the self-assessment was done by a feasibility questionnaire.

Results

The quadratic weighted kappa was 0.60 between the assessment of the physician and structured interview and 0.56 between assessment of the physician and self-assessment. Percentage agreement was, respectively, 50.8 and 19.6%. The assessment of the mRS through a structured interview and by self-assessment resulted in systematically higher mRS scores than the mRS scored by the physician. Self-assessment of the mRS was proven feasible.

Discussion

The mRS scores obtained with different assessment methods differ significantly. The agreement between the scores is low, although the reliability between the assessment methods is good. This should be considered when using the mRS in clinical trials.

Trial registration

www.trialregister.nl; Unique identifier: NL7859.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00415-021-10880-4.

SUBMITTER: Nobels-Janssen E

PROVIDER: S-EPMC8572691 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:The diagnosis of cerebral vasospasm after Subarachnoid-Hemorrhage is currently very difficult, additional tools such as blood biomarkers are necessary. We tested the ability of gene expression profiles of blood cells to predict vasospasm. 32 patients suffering subarachnoid-hemorrhage were included in this prospective monocentre study. They were grouped according to have a complicated cerebral vasospasm (Vasospasm) or not (Control) and Paired according to age (+/- 10 years), sex, Fisher grade (+/- 1), location, smoking (at least 3 first parameters). Gene expression profiles of blood cells were determined using 25,000~gene microarray. Blood sample: 2.5 mL harvested in PAXgene® Blood RNA tubes (PreAnalytix) RNA extraction: PAXgene® Blood RNA kit (Qiagen). We used a Universel Reference RNA (Stratagene). RNA amplification and labelling: kit Amino Allyl MessageAmp II (Ambion). We hybridized 4 microarrays per patient using pangenomic microarrays from the "Réseau National des Génopôles" (Illkirch, France). 2 slides were hybridized with reference RNA labelled Cy3 and patient RNA labelled Cy5, and 2 slides were hybridized with reference RNA labelled Cy5 and patient RNA labelled Cy3. Hybridation : Agilent protocol with few modifications : 750 ng of each labelled RNA were hubriddized at 60°C during 17 hours in an Aglient hybridization oven. After washings, Slides were scanned with a GenePix 4000B scanner (Molecular Devices). Image intensity data were extracted with GenePix Pro 6.0 analysis software. Quantification of Cy3 and Cy5 and selection of good spots were performed using the MAIA software (Novikov E and Barillot E. Software package for automatic microarray image analysis (MAIA). The ACUITY software was then used to normalize log ratios Cy3/Cy5 with Lowess non linear normalization, to filter out genes not present in at least 3 slides out of 4, to evaluate the reproducibility of the 4 microarrays of each patient (hierarchical clustering, Self Organizing Maps). Statistical analyses to insure reproducibility was performed using Excel (correlation coefficients, ANOVA). Only slides that passed all reprocubility tests were validated.

Project description:Importance:The utility-weighted modified Rankin Scale (UW-mRS) has been proposed as a patient-centered alternative primary outcome for stroke clinical trials. However, to date, there is no clear consensus on an approach to weighting the mRS. Objective:To characterize the between-study variability in utility weighting of the mRS in a population of patients who experienced stroke and its implications when applied to the results of a clinical trial. Data Sources:In this systematic review and meta-analysis, MEDLINE, Embase, and PsycINFO were searched from January 1987 through May 2019 using major search terms for stroke, health utility, and mRS. Study Selection:Original research articles published in English were reviewed. Included were studies with participants 18 years or older with ischemic or hemorrhagic stroke, transient ischemic attack, or subarachnoid hemorrhage, with mRS scores and utility weights evaluated concurrently. A total of 5725 unique articles were identified. Of these, 283 met criteria for full-text review, and 24 were included in the meta-analysis. Data Extraction and Synthesis:PRISMA guidelines for systematic review were followed. Data extraction was performed independently by multiple researchers. Data were pooled using mixed models. Main Outcomes and Measures:The mean utility weights and 95% CIs were calculated for each mRS score and health utility scale. Geographic differences in weighting for the EuroQoL 5-dimension (EQ-5D) and Stroke Impact Scale-based UW-mRS were explored using inverse variance-weighted linear models. The results of 18 major acute stroke trials cited in current guidelines were then reanalyzed using the UW-mRS weighting scales identified in the systematic review. Results:The meta-analysis included 22 389 individuals; the mean (SD) age of participants was 65.9 (4.0) years, and the mean (SD) proportion of male participants was 58.2% (7.5%). For all health utility scales evaluated, statistically significant differences were observed between the mean utility weights by mRS score. For studies using an EQ-5D-weighted mRS, between-study variance was higher for worse (mRS 2-5) compared with better (mRS 0-1) scores. Of the 18 major acute stroke trials with reanalyzed results, 3 had an unstable outcome when using different UW-mRSs. Conclusions and Relevance:Multiple factors, including cohort-specific characteristics and health utility scale selection, can influence mRS utility weighting. If the UW-mRS is selected as a primary outcome, the approach to weighting may alter the results of a clinical trial. Researchers using the UW-mRS should prospectively and concurrently obtain mRS scores and utility weights to characterize study-specific outcomes.