Dataset Information

Interobserver Agreement in the Assessment of Clinical Findings in Children with Headaches.

ABSTRACT:

Objective

To determine the interobserver agreement of history and physical examination findings in children undergoing evaluation in the emergency department (ED) for headaches.

Study design

We conducted a prospective, cross-sectional study of children aged 2-17 years evaluated at 3 tertiary-care pediatric EDs for non-traumatic headaches. Two clinicians independently completed a standardized assessment of each child and documented the presence or absence of history and physical examination variables. Unweighted κ statistics were determined for 68 history and 24 physical examination variables.

Results

We analyzed 191 paired observations; median age was 12 years, with 19 (9.9%) children younger than 7 years. Interrater reliability was at least moderate (κ ≥ 0.41) for 41 (60.3%) patient history variables. Eleven (61.1%) of 18 physical examination variables for which κ statistics could be calculated had a κ that was at least moderate.

Conclusions

A substantial number of history and physical examination findings demonstrated at least moderate κ statistic values when assessed in children with headaches in the ED. These variables may be generalizable across different types of clinicians for evaluation of children with headaches. If also found to predict the presence or absence of emergent intracranial abnormalities, the more reliable clinical findings may be helpful in the development of clinical prediction rules or risk stratification models that could be used across settings for children with headaches.

SUBMITTER: Tsze DS

PROVIDER: S-EPMC7251971 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundEducational video datasets can be an effective method for training in emergency department (ED) point-of-care ultrasound (PoCUS). A video dataset for normal appendix and appendicitis in children using ED PoCUS images was developed to assess interobserver agreement, as measured by Cohen's Kappa on key sonographic findings.MethodsThree sets of 25 ED PoCUS videos were selected and curated from pediatric patients with normal appendix and acute appendicitis. Four participant ED sonologist-physicians were trained on the first set of 25 videos showing normal appendix or normal bowel in patients without appendicitis to note if normal appendix was seen in any part or in it's entirety from tip-to-cecum. They were then tested on the second set of similar videos. A third set of 25 videos from patients who had appendicitis where participant sonologists were asked to note if appendicitis was present or absent, with and without appendicolith or perforation. Cohen's Kappa was calculated in aggregate and stratified by experience vs. novice against a senior sonologist-physician aware of all patient outcomes for visualization of: 1. any part of normal appendix, 2. normal appendix visualized from tip to cecum 3. any part of appendicitis, 4. appendicolith, 5. appendiceal perforation.ResultsCohen's Kappa for any part of normal appendix, 0.71, 95% CI (0.58-0.85); normal appendix tip-to-cecum, 0.43, 95% CI (0.19-0.67), appendicitis, 0.53, 95%CI (0.34-0.70), appendicolith, 0.63, 95%CI (0.43-0.84), perforated appendicitis, 0.46, 95%CI (0.22-0.70). Stratified by experienced vs. novice: any part of normal appendix, 0.75 vs. 0.68; normal appendix tip-to-cecum, 0.50 vs. 0.36; appendicitis, 0.78 vs. 0.31; appendicolith, 0.75 vs. 0.5; perforated appendicitis, 0.5 vs 0.42.ConclusionsThis educational video dataset may be used to train sonologist-physicians in ED PoCUS scanning for normal appendix and appendicitis in children. Sonologist experience affected interobserver agreement with respect to visualization of entire normal appendix and appendicitis.