Dataset Information

Implicit Review Instrument to Evaluate Quality of Care Delivered by Physicians to Children in Emergency Departments.

ABSTRACT: OBJECTIVE:To evaluate the consistency, reliability, and validity of an implicit review instrument that measures the quality of care provided to children in the emergency department (ED). DATA SOURCES/STUDY SETTING:Medical records of randomly selected children from 12 EDs in the Pediatric Emergency Care Applied Research Network (PECARN). STUDY DESIGN:Eight pediatric emergency medicine physicians applied the instrument to 620 medical records. DATA COLLECTION/EXTRACTION METHODS:We determined internal consistency using Cronbach's alpha and inter-rater reliability using the intraclass correlation coefficient (ICC). We evaluated the validity of the instrument by correlating scores with four condition-specific explicit review instruments. PRINCIPAL FINDINGS:Individual reviewers' Cronbach's alpha had a mean of 0.85 with a range of 0.76-0.97; overall Cronbach's alpha was 0.90. The ICC was 0.49 for the summary score with a range from 0.40 to 0.46. Correlations between the quality of care score and the four condition-specific explicit review scores ranged from 0.24 to 0.38. CONCLUSIONS:The quality of care instrument demonstrated good internal consistency, moderate inter-rater reliability, high inter-rater agreement, and evidence supporting validity. The instrument could be useful for systems' assessment and research in evaluating the care delivered to children in the ED.

SUBMITTER: Marcin JP

PROVIDER: S-EPMC5980311 | biostudies-literature | 2018 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Implicit Review Instrument to Evaluate Quality of Care Delivered by Physicians to Children in Emergency Departments.

Marcin James P JP Romano Patrick S PS Dharmar Madan M Chamberlain James M JM Dudley Nanette N Macias Charles G CG Nigrovic Lise E LE Powell Elizabeth C EC Rogers Alexander J AJ Sonnett Meridith M Tzimenatos Leah L Alpern Elizabeth R ER Andrews-Dickert Rebecca R Borgialli Dominic A DA Sidney Erika E Casper Charlie C Dean Jonathan Michael JM Kuppermann Nathan N

Health services research 20171116 3

<h4>Objective</h4>To evaluate the consistency, reliability, and validity of an implicit review instrument that measures the quality of care provided to children in the emergency department (ED).<h4>Data sources/study setting</h4>Medical records of randomly selected children from 12 EDs in the Pediatric Emergency Care Applied Research Network (PECARN).<h4>Study design</h4>Eight pediatric emergency medicine physicians applied the instrument to 620 medical records.<h4>Data collection/extraction met ...[more]

PMID: 29143331

Similar Datasets

Project description:BackgroundThere are few outcomes experienced by children receiving care in the Emergency Department (ED) that are amenable to measuring for the purposes of assessing of quality of care. The purpose of this study was to develop, test, and validate a new implicit review instrument that measures quality of care delivered to children in EDs.MethodsWe developed a 7-point structured implicit review instrument that encompasses four aspects of care, including the physician's initial data gathering, integration of information and development of appropriate diagnoses; initial treatment plan and orders; and plan for disposition and follow-up. Two pediatric emergency medicine physicians applied the 5-item instrument to children presenting in the highest triage category to four rural EDs, and we assessed the reliability of the average summary scores (possible range of 5-35) across the two reviewers using standard measures. We also validated the instrument by comparing this mean summary score between those with and without medication errors (ascertained independently by two pharmacists) using a two-sample t-test.ResultsWe reviewed the medical records of 178 pediatric patients for the study. The mean and median summary score for this cohort of patients were 27.4 and 28.5, respectively. Internal consistency was high (Cronbach's alpha of 0.92 and 0.89). All items showed a significant (p < 0.005) positive correlation between reviewers using the Spearman rank correlation (range 0.24 to 0.39). Exact agreement on individual items between reviewers ranged from 70.2% to 85.4%. The Intra-class Correlation Coefficient for the mean of the total summary score across the two reviewers was 0.65. The validity of the instrument was supported by the finding of a higher score for children without medication errors compared to those with medication errors which trended toward significance (mean score = 28.5 vs. 26.0, p = 0.076).ConclusionThe instrument we developed to measure quality of care provided to children in the ED has high internal consistency, fair to good inter-rater reliability and inter-rater correlation, and high content validity. The validity of the instrument is supported by the fact that the instrument's average summary score was lower in the presence of medication errors, which trended towards statistical significance.

Project description:The objectives of this study were to determine concordance of emergency department (ED) management of acute myocardial infarction (AMI) with guideline recommendations and to identify ED and patient characteristics predictive of higher guideline concordance.The authors conducted a chart review study of ED AMI care as part of the National Emergency Department Safety Study (NEDSS). Using a primary hospital discharge diagnosis of AMI (International Classification of Diseases, Ninth Revision, Clinical Modification [ICD-9-CM], codes 410.XX), a random sample of ED visits for AMI in 58 urban EDs across 20 U.S. states between 2003 and 2006 were identified. Concordance with American College of Cardiology/American Heart Association (ACC/AHA) guideline recommendations was evaluated using five individual quality measures and a composite concordance score. Concordance scores were calculated as the percentage of eligible patients who received guidelines-recommended care. These percentage scores were rescaled from 0 to 100, with 100 indicating perfect concordance.The cohort consisted of 3,819 subjects; their median age was 65 years, and 62% were men. The mean (± standard deviation [SD]) ED composite concordance score was 61?±?8), with a broad range of values (42 to 84). Except for aspirin use (mean concordance, 82), ED concordance scores were low (beta-blocker use, 56; timely electrocardiogram [ECG], 41; timely fibrinolytic therapy, 26; timely ED disposition for primary percutaneous coronary intervention [PCI] candidates, 43). In multivariable analyses, older age (beta-coefficient per 10-year increase, -1.5; 95% confidence interval [CI]?=?-2.4 to -0.5) and southern EDs (beta-coefficient, -5.2; 95% CI?=?-9.6 to -0.9) were associated with lower guideline concordance, whereas ST-segment elevation on initial ED ECG was associated with higher guideline concordance (beta-coefficient, 3.6; 95% CI?= 1.5 to 5.7).Overall ED concordance with guideline-recommended processes of care was low to moderate. Emergency physicians should continue to work with other stakeholders in AMI care, such as emergency medical services (EMS) and cardiologists, to develop strategies to improve care processes.

Project description:Evidence-based indicators of quality of care have been developed to improve care and performance in Canadian emergency departments. The feasibility of measuring these indicators has been assessed mainly in urban and academic emergency departments. We sought to assess the feasibility of measuring quality-of-care indicators in rural emergency departments in Quebec.We previously identified rural emergency departments in Quebec that offered medical coverage with hospital beds 24 hours a day, 7 days a week and were located in rural areas or small towns as defined by Statistics Canada. A standardized protocol was sent to each emergency department to collect data on 27 validated quality-of-care indicators in 8 categories: duration of stay, patient safety, pain management, pediatrics, cardiology, respiratory care, stroke and sepsis/infection. Data were collected by local professional medical archivists between June and December 2013.Fifteen (58%) of the 26 emergency departments invited to participate completed data collection. The ability to measure the 27 quality-of-care indicators with the use of databases varied across departments. Centres 2, 5, 6 and 13 used databases for at least 21 of the indicators (78%-92%), whereas centres 3, 8, 9, 11, 12 and 15 used databases for 5 (18%) or fewer of the indicators. On average, the centres were able to measure only 41% of the indicators using heterogeneous databases and manual extraction. The 15 centres collected data from 15 different databases or combinations of databases. The average data collection time for each quality-of-care indicator varied from 5 to 88.5 minutes. The median data collection time was 15 minutes or less for most indicators.Quality-of-care indicators were not easily captured with the use of existing databases in rural emergency departments in Quebec. Further work is warranted to improve standardized measurement of these indicators in rural emergency departments in the province and to generalize the information gathered in this study to other health care environments.

Project description:ObjectivesLittle academic investigation has been done to describe emergency department (ED) practice structure and quality improvement activities. Our objective was to describe staffing, payment mechanisms, and quality improvement activities among EDs in a nationwide quality improvement network and also stratify results to descriptively compare (1) single- versus multi-site EDs and (2) small-group versus large-group EDs.MethodsObservational study examining EDs that completed activities for the 2018 wave of the Emergency Quality Network (E-QUAL), a voluntary network of EDs nationwide that self-report quality improvement activities. EDs were defined as single-site or multi-site based on self-reported billing practices; additionally, EDs were defined as large-group if they and a majority of other sites with the same group name also identified as multi-site. All other sites were deemed small-group.ResultsData from 377 EDs were included. For staffing, the median number of clinicians was 17 overall (16 single-site; 19 multi-site). For payment, 376 of 377 EDs (99.7%) participated in the Merit-Based Incentive Payment System. Thirty-five EDs (9.2%) participated in a federal alternative payment model, and 19 (5.0%) participated in a commercial alternative payment model. For quality improvement, single- and multi-site EDs reported similar progress on quality improvement strategies; however, small-group EDs reported more advanced quality improvement strategies compared to large-group EDs for 8/10 quality improvement strategies included in a survey (eg, "achieved a formal plan to eliminate waste").ConclusionAmong EDs in E-QUAL, staffing, payment, and quality improvement activities are similar between single- and multi-site EDs. Group-level analysis suggests that practice structure may influence adoption of quality improvement strategies. Future work is needed to further evaluate practice structure and its influence on quality improvement activities and quality.

Dataset Information

Implicit Review Instrument to Evaluate Quality of Care Delivered by Physicians to Children in Emergency Departments.

Publications

Implicit Review Instrument to Evaluate Quality of Care Delivered by Physicians to Children in Emergency Departments.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets