Dataset Information

Ranking hospitals when performance and risk factors are correlated: A simulation-based comparison of risk adjustment approaches for binary outcomes.

ABSTRACT: BACKGROUND:The conceptualization of hospital quality indicators usually includes some form of risk adjustment to account for hospital differences in case mix. For binary outcome variables like in-hospital mortality, frequently utilized risk adjusted measures include the standardized mortality ratio (SMR), the risk standardized mortality rate (RSMR), and excess risk (ER). All of these measures require the estimation of expected hospital mortality, which is often based on logistic regression models. In this context, an issue that is often neglected is correlation between hospital performance (e.g. care quality) and patient-specific risk factors. The objective of this study was to investigate the impact of such correlation on the adequacy of hospital rankings based on different measures and methods. METHODS:Using Monte Carlo simulation, the impact of correlation between hospital care quality and patient-specific risk factors on the adequacy of hospital rankings was assessed for SMR/RSMR, and ER based on logistic regression and random effects logistic regression. As an alternative method, fixed effects logistic regression with Firth correction was considered. The adequacies of the resulting hospital rankings were assessed by the shares of hospitals correctly classified into quintiles according to their true (unobserved) care qualities. RESULTS:The performance of risk adjustment approaches based on logistic regression and random effects logistic regression declined when correlation between care quality and a risk factor was induced. In contrast, fixed-effects-based estimations proved to be more robust. This was particularly true for fixed-effects-logistic-regression-based ER. In the absence of correlation between risk factors and care quality, all approaches showed similar performance. CONCLUSIONS:Correlation between risk factors and hospital performance may severely bias hospital rankings based on logistic regression and random effects logistic regression. ER based on fixed effects logistic regression with Firth correction should be considered as an alternative approach to assess hospital performance.

SUBMITTER: Roessler M

PROVIDER: S-EPMC6892499 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Ranking hospitals when performance and risk factors are correlated: A simulation-based comparison of risk adjustment approaches for binary outcomes.

Roessler Martin M Schmitt Jochen J Schoffer Olaf O

PloS one 20191204 12

<h4>Background</h4>The conceptualization of hospital quality indicators usually includes some form of risk adjustment to account for hospital differences in case mix. For binary outcome variables like in-hospital mortality, frequently utilized risk adjusted measures include the standardized mortality ratio (SMR), the risk standardized mortality rate (RSMR), and excess risk (ER). All of these measures require the estimation of expected hospital mortality, which is often based on logistic regressi ...[more]

PMID: 31800610

Similar Datasets

Project description:Importance:Current surgical quality metrics might be insufficient to fully judge the quality of certain operations because they are not procedure specific. Hypocalcemia, recurrent laryngeal nerve (RLN) injury, and hematoma are considered to be the most relevant outcomes to measure after thyroidectomy. Whether these outcomes can be used as hospital quality metrics is unknown. Objectives:To evaluate whether thyroidectomy-specific outcomes vary among hospitals, whether the addition of thyroidectomy-specific variables affects risk adjustment, and whether differences in hospital performance are associated with thyroidectomy-specific care processes. Design, Setting, and Participants:In this retrospective cohort study, patients undergoing thyroidectomies from January 1, 2013, through December 31, 2015, at hospitals participating in the American College of Surgeons' National Surgical Quality Improvement Program were studied. Exposure:Thyroidectomy-related care. Main Outcomes and Measures:Clinically severe hypocalcemia, RLN injury, and clinically significant hematoma within 30 days of thyroid surgery and hospital-level performance variation, change in risk adjustment, and association with processes. Results:Overall, 14 540 patients (mean [SD] age, 52.1 [15.0] years; 11 499 [79.1%] female) underwent operations at 98 hospitals. Because operations missing thyroidectomy-specific outcomes were excluded, the numbers of operations and hospitals analyzed differed by outcome. Of 14 540 operations included, clinically severe hypocalcemia occurred in 450 patients (3.3% overall, 0.6% after partial, and 4.7% after subtotal or total thyroidectomy), RLN injury in 755 patients (5.7% overall, 4.2% after partial, and 6.6% after subtotal or total thyroidectomy), and hematoma in 175 patients (1.3%). Hospital performance varied for hypocalcemia and RLN injury but not for hematoma. Hospital performance rankings were largely unaffected by the inclusion of thyroidectomy-specific data in risk adjustment. With regard to processes, patients undergoing thyroidectomies at the best-performing vs worst-performing hospitals less frequently had their postoperative parathyroid hormone level measured (593 [19.9%] vs 457 [31.7%], P < .001) and more often were prescribed oral calcium, vitamin D, or both (2281 [76.6%] vs 962 [66.8%], P < .001). When profiled by RLN injury, use of energy devices (1517 [69.1%] vs 507 [55.2%], P < .001) and intraoperative nerve monitoring (1223 [55.7%] vs 346 [37.7%], P < .001) were more prevalent at the best- compared with the worst-performing hospitals. Conclusions and Relevance:Postoperative hypocalcemia and RLN injury, but not hematoma, potentially could be used as thyroidectomy-specific national hospital quality improvement metrics. Strategies aimed at reducing these complications after thyroidectomy may improve the care of these patients.

Project description:ObjectivesWhite matter lesions are a very common finding on MRI in older adults and their presence increases the risk of stroke and dementia. Accurate and computationally efficient modelling methods are necessary to map the association of lesion incidence with risk factors, such as hypertension. However, there is no consensus in the brain mapping literature whether a voxel-wise modelling approach is better for binary lesion data than a more computationally intensive spatial modelling approach that accounts for voxel dependence.MethodsWe review three regression approaches for modelling binary lesion masks including mass-univariate probit regression modelling with either maximum likelihood estimates, or mean bias-reduced estimates, and spatial Bayesian modelling, where the regression coefficients have a conditional autoregressive model prior to account for local spatial dependence. We design a novel simulation framework of artificial lesion maps to compare the three alternative lesion mapping methods. The age effect on lesion probability estimated from a reference data set (13,680 individuals from the UK Biobank) is used to simulate a realistic voxel-wise distribution of lesions across age. To mimic the real features of lesion masks, we propose matching brain lesion summaries (total lesion volume, average lesion size and lesion count) across the reference data set and the simulated data sets. Thus, we allow for a fair comparison between the modelling approaches, under a realistic simulation setting.ResultsOur findings suggest that bias-reduced estimates for voxel-wise binary-response generalized linear models (GLMs) overcome the drawbacks of infinite and biased maximum likelihood estimates and scale well for large data sets because voxel-wise estimation can be performed in parallel across voxels. Contrary to the assumption of spatial dependence being key in lesion mapping, our results show that voxel-wise bias-reduction and spatial modelling result in largely similar estimates.ConclusionsBias-reduced estimates for voxel-wise GLMs are not only accurate but also computationally efficient, which will become increasingly important as more biobank-scale neuroimaging data sets become available.

Dataset Information

Ranking hospitals when performance and risk factors are correlated: A simulation-based comparison of risk adjustment approaches for binary outcomes.

Publications

Ranking hospitals when performance and risk factors are correlated: A simulation-based comparison of risk adjustment approaches for binary outcomes.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets