Dataset Information

On the practice of ignoring center-patient interactions in evaluating hospital performance.

ABSTRACT: We evaluate the performance of medical centers based on a continuous or binary patient outcome (e.g., 30-day mortality). Common practice adjusts for differences in patient mix through outcome regression models, which include patient-specific baseline covariates (e.g., age and disease stage) besides center effects. Because a large number of centers may need to be evaluated, the typical model postulates that the effect of a center on outcome is constant over patient characteristics. This may be violated, for example, when some centers are specialized in children or geriatric patients. Including interactions between certain patient characteristics and the many fixed center effects in the model increases the risk for overfitting, however, and could imply a loss of power for detecting centers with deviating mortality. Therefore, we assess how the common practice of ignoring such interactions impacts the bias and precision of directly and indirectly standardized risks. The reassuring conclusion is that the common practice of working with the main effects of a center has minor impact on hospital evaluation, unless some centers actually perform substantially better on a specific group of patients and there is strong confounding through the corresponding patient characteristic. The bias is then driven by an interplay of the relative center size, the overlap between covariate distributions, and the magnitude of the interaction effect. Interestingly, the bias on indirectly standardized risks is smaller than on directly standardized risks. We illustrate our findings by simulation and in an analysis of 30-day mortality on Riksstroke.

SUBMITTER: Varewyck M

PROVIDER: S-EPMC5049670 | biostudies-literature | 2016 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

On the practice of ignoring center-patient interactions in evaluating hospital performance.

Varewyck Machteld M Vansteelandt Stijn S Eriksson Marie M Goetghebeur Els E

Statistics in medicine 20150824 2

We evaluate the performance of medical centers based on a continuous or binary patient outcome (e.g., 30-day mortality). Common practice adjusts for differences in patient mix through outcome regression models, which include patient-specific baseline covariates (e.g., age and disease stage) besides center effects. Because a large number of centers may need to be evaluated, the typical model postulates that the effect of a center on outcome is constant over patient characteristics. This may be vi ...[more]

PMID: 26303843

Similar Datasets

Project description:BackgroundIn 2006, our healthcare system created a hospital Evidence-based Practice Center (EPC) to support the local delivery of high-quality, safe and high value patient care. Since then, the importance of healthcare staff work life has also been highlighted, and together these four elements form the Quadruple Aim framework. Synergistic to this Aim, the Magnet® program promotes and recognizes organizational nursing excellence.ObjectiveTo examine the EPC's work to inform nursing policy and practice in support of the goals of the Quadruple Aim framework and Magnet® designation.MethodsMethods used included the following: (1) descriptive analysis of the hospital EPC's database of rapid reviews; and (2) administration of a 40-item electronic questionnaire to nurses who requested an EPC review during fiscal years (FY) 2015 and 2016.ResultsOf 308 rapid reviews completed in the EPC's first 10 years, 59 (19%) addressed nursing topics. The proportion of reviews relevant to nursing increased from 5% (2/39) in the center's first 2 years to 44% (25/60) in FY 2015-2016. The majority of nursing reviews (39/59) examined processes of care. Of 23 nurses eligible to participate in the survey, 21 responded (91%). Nurses with administrative or managerial responsibilities requested 70% of reviews; clinical nurse specialists and bedside nurses requested 17% and 9%, respectively. Reviews were used to support clinical program development (48%), provide clinical guidance (33%), update nursing policies or procedures (24%) and develop training and curricula (24%). Nurses were satisfied with the hospital EPC reviews (mean; 4.7/5), and 95% indicated they were likely to request a future review.Linking evidence to actionA dedicated hospital EPC in partnership with nursing offers a unique mechanism for promoting a culture of evidence-based practice. Nurses at all organizational levels use the services of a hospital EPC to inform nursing policy and practice and are highly satisfied with the process, supporting the Quadruple Aim and Magnet® designation.

Project description:ImportanceSurvival rates after in-hospital cardiac arrest (IHCA) vary significantly among US centers; whether this variation is owing to differences in IHCA care quality is unknown.ObjectiveTo evaluate hospital-level variation to determine whether hospital process composite performance measures of IHCA care quality are associated with patient outcomes.Design, setting, and participantsUsing data from the American Heart Association's Get With the Guidelines-Resuscitation (GWTG-R) program, we analyzed 35 283 patients 18 years or older with IHCA treated at 261 US hospitals from January 1, 2010, through December 31, 2012. We calculated the hospital process composite performance score for IHCA using 5 guideline-recommended process measures. Opportunity-based scores were calculated for all patients, aggregated at the hospital level, divided into quartiles, and then associated with risk-standardized survival and neurologic status by a test for trend. The scores were then evaluated through hierarchical logistic regression and reported as odds ratios per 10% increment in hospital process composite performance.InterventionsAcute care treatments for IHCA.Main outcomes and measuresThe primary outcome was survival to discharge measured as risk standard survival rates, and the secondary outcome was favorable neurologic status at hospital discharge.ResultsOf the 35 283 adults included in this study, the median age was 67 years (interquartile range [IQR] 56-78 years), and 57.9% were male. The median IHCA hospital process composite performance was 89.7% (interquartile range, 85.4%-93.1%) and varied among hospital quartiles from 82.6% (lowest) to 94.8% (highest). The IHCA hospital process composite performance was linearly associated with risk-standardized hospital survival to discharge rates: 21.1%, 21.4%, 22.8%, and 23.4% from lowest to highest performance quartiles, respectively (P < .001). After adjustment, each 10% increase in a hospital's process composite performance was associated with a 22% higher odds of survival (adjusted odds ratio, 1.22; 95% CI, 1.08-1.37; P = .01). Hospital process composite quality performance was also associated with favorable neurologic status at discharge (P = .004).Conclusions and relevanceThe quality of guideline-based care for IHCA varies significantly among US hospitals and is associated with patient survival and neurologic outcomes.

Dataset Information

On the practice of ignoring center-patient interactions in evaluating hospital performance.

Publications

On the practice of ignoring center-patient interactions in evaluating hospital performance.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure