Dataset Information

Interrater reliability of the Pediatric National Institutes of Health Stroke Scale (PedNIHSS) in a multicenter study.

ABSTRACT: Stroke is an important cause of death and disability among children. Clinical trials for childhood stroke require a valid and reliable acute clinical stroke scale. We evaluated interrater reliability (IRR) of a pediatric adaptation of the National Institutes of Health Stroke Scale.The pediatric adaptation of the National Institutes of Health Stroke Scale was developed by pediatric and adult stroke experts by modifying each item of the adult National Institutes of Health Stroke Scale for children, retaining all examination items and scoring ranges of the National Institutes of Health Stroke Scale. Children 2 to 18 years of age with acute arterial ischemic stroke were enrolled in a prospective cohort study from 15 North American sites from January 2007 to October 2009. Examiners were child neurologists certified in the adult National Institutes of Health Stroke Scale. Each subject was examined daily for 7 days or until discharge. A subset of patients at 3 sites was scored simultaneously and independently by 2 study neurologists.IRR testing was performed in 25 of 113 a median of 3 days (interquartile range, 2 to 4 days) after symptom onset. Patient demographics, total initial pediatric adaptation of the National Institutes of Health Stroke Scale scores, risk factors, and infarct characteristics in the IRR subset were similar to the non-IRR subset. The 2 raters' total scores were identical in 60% and within 1 point in 84%. IRR was excellent as measured by concordance correlation coefficient of 0.97 (95% CI, 0.94 to 0.99); intraclass correlation coefficient of 0.99 (95% CI, 0.97 to 0.99); precision measured by Pearson ? of 0.97; and accuracy measured by the bias correction factor of 1.0.There was excellent IRR of the pediatric adaptation of the National Institutes of Health Stroke Scale in a multicenter prospective cohort performed by trained child neurologists.

SUBMITTER: Ichord RN

PROVIDER: S-EPMC3065389 | biostudies-literature | 2011 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Interrater reliability of the Pediatric National Institutes of Health Stroke Scale (PedNIHSS) in a multicenter study.

Ichord Rebecca N RN Bastian Rachel R Abraham Lisa L Askalan Rand R Benedict Susan S Bernard Timothy J TJ Beslow Lauren L Deveber Gabrielle G Dowling Michael M Friedman Neil N Fullerton Heather H Jordan Lori L Kan Li L Kirton Adam A Amlie-Lefond Catherine C Licht Daniel D Lo Warren W McClure Chalmer C Pavlakis Steve S Smith Sabrina E SE Tan Marilyn M Kasner Scott S Jawad Abbas F AF

Stroke 20110211 3

<h4>Background and purpose</h4>Stroke is an important cause of death and disability among children. Clinical trials for childhood stroke require a valid and reliable acute clinical stroke scale. We evaluated interrater reliability (IRR) of a pediatric adaptation of the National Institutes of Health Stroke Scale.<h4>Methods</h4>The pediatric adaptation of the National Institutes of Health Stroke Scale was developed by pediatric and adult stroke experts by modifying each item of the adult National ...[more]

PMID: 21317270

Similar Datasets

Project description:The lack of standardized criteria for measuring therapeutic response is a major obstacle to the development of new therapeutic agents for chronic graft-versus-host disease (cGVHD). National Institutes of Health (NIH) consensus criteria for evaluating therapeutic response were published in 2006. We report the results of 4 consecutive pilot trials evaluating the feasibility and estimating the interrater reliability and minimum detectable change of these response criteria. Hematology-oncology clinicians with limited experience in applying the NIH cGVHD response criteria (n = 34) participated in a 2.5-hour training session on response evaluation in cGVHD. Feasibility and interrater reliability between subspecialty cGVHD experts and this panel of clinician raters were examined in a sample of 25 children and adults with cGVHD. The minimum detectable change was calculated using the standard error of measurement. Clinicians' impressions of the brief training session, the photo atlas, and the response criteria documentation tools were generally favorable. Performing and documenting the full set of response evaluations required a median of 21 minutes (range: 12-60 minutes) per rater. The Schirmer tear test required the greatest time of any single test (median: 9 minutes). Overall, interrater agreement for skin and oral manifestations was modest; however, in the third and fourth trials, the agreement between clinicians and experts for all dimensions except movable sclerosis approached satisfactory values. In the final 2 trials, the threshold for defining change exceeding measurement error was 19% to 22% body surface area (BSA) for erythema, 18% to 26% BSA for movable sclerosis, 17% to 21% BSA for nonmovable sclerosis, and 2.1 to 2.6 points on the 15-point NIH Oral cGHVD scale. Agreement between clinician-expert pairs was moderate to substantial for the measures of functional capacity and for the gastrointestinal and global cGVHD rating scales. These results suggest that the NIH response criteria are feasible for use, and these reliability estimates are encouraging, because they were observed following a single 2.5-hour training session given at multiple transplant centers, with no opportunity for iterative training and calibration. Research is needed to evaluate inter- and intrarater reliability in larger samples, and to evaluate these response criteria as predictors of outcomes in clinical trials.

Project description:BackgroundNational Institutes of Health Stroke Scale (NIHSS) is the most validated clinical scale for stroke recognition, severity grading, and symptom monitoring in acute care and hospital settings. Numerous modified prehospital stroke scales exist, but these scales contain less clinical information and lack compatibility with in-hospital stroke scales. In this real-life study, we aimed to investigate if NIHSS conducted by paramedics in the field is a feasible and accurate prehospital diagnostic tool.MethodsThis prospective cohort study is part of Treat-NASPP (Treat-Norwegian Acute Stroke Prehospital Project) conducted at a single medical center in Østfold, Norway. Sixty-three paramedics were trained and certified in NIHSS, and the prehospital NIHSS scores were compared with the scores obtained by in-hospital stroke physicians. Interrater agreement was assessed using a Bland-Altman plot with 95% limits of agreement. In secondary analysis, Cohen κ was used for the clinical categories NIHSS score of 0 to 5 and ≥6. As a safety measure, prehospital time was compared between paramedics conducting NIHSS and conventional paramedics.ResultsWe included 274 patients. The mean difference in NIHSS scores between the paramedics and the stroke physicians was 0.92 with limits of agreement from -5.74 to 7.59. Interrater agreement for the 2 clinical categories was moderate with a κ of 0.58. The prehospital NIHSS scoring was performed mean (SD) 42 (14) minutes earlier than the in-hospital scoring. Prehospital time was not significantly increased in the NIHSS-trained paramedic group compared with conventional paramedics (median [interquartile range] on-scene-time 18 [13-25] minutes versus 16 [11-23] minutes, P=0.064 and onset-to-hospital time 86 [65-128] minutes versus 84 [56-140] minutes, P=0.535).ConclusionsParamedics can use NIHSS as an accurate and time efficient prehospital stroke severity quantification tool. Introducing NIHSS in the emergency medical services will enable prehospital evaluation of stroke progression and provide a common language for stroke assessment between paramedics and stroke physicians.RegistrationURL: https://www.Clinicaltrialsgov; Unique identifier: NCT03158259.

Dataset Information

Interrater reliability of the Pediatric National Institutes of Health Stroke Scale (PedNIHSS) in a multicenter study.

Publications

Interrater reliability of the Pediatric National Institutes of Health Stroke Scale (PedNIHSS) in a multicenter study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets