Dataset Information

Handling over-dispersion of performance indicators.

ABSTRACT:

Objectives

A problem can arise when a performance indicator shows substantially more variability than would be expected by chance alone, since ignoring such "over-dispersion" could lead to a large number of institutions being inappropriately classified as "abnormal". A number of options for handling this phenomenon are investigated, ranging from improved risk stratification to fitting a statistical model that robustly estimates the degree of over-dispersion.

Design

Retrospective analysis of publicly available data on survival following coronary artery bypass grafts, emergency readmission rates, and teenage pregnancies.

Setting

NHS trusts in England.

Results

Funnel plots clearly show the influence of the method chosen for dealing with over-dispersion on the "banding" a trust receives. Both multiplicative and additive approaches are feasible and give intuitively reasonable results, but the additive random effects formulation appears to have a stronger conceptual foundation.

Conclusion

A random effects model may offer a reasonable solution. This method has now been adopted by the UK Healthcare Commission in their derivation of star ratings.

SUBMITTER: Spiegelhalter DJ

PROVIDER: S-EPMC1744077 | biostudies-literature | 2005 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Handling over-dispersion of performance indicators.

Spiegelhalter D J DJ

Quality & safety in health care 20051001 5

<h4>Objectives</h4>A problem can arise when a performance indicator shows substantially more variability than would be expected by chance alone, since ignoring such "over-dispersion" could lead to a large number of institutions being inappropriately classified as "abnormal". A number of options for handling this phenomenon are investigated, ranging from improved risk stratification to fitting a statistical model that robustly estimates the degree of over-dispersion.<h4>Design</h4>Retrospective a ...[more]

PMID: 16195568

Similar Datasets

Project description:Cancers of the upper gastro-intestinal tract, including esophagus (gullet), stomach and small bowel, are amongst the deadliest malignancies. The main reason for their high mortality rate is that they are usually diagnosed late when curative treatments are no longer effective. However, these types of cancer generally arise from well-described pre-cancerous diseases, such as Barrett’s esophagus and gastric intestinal metaplasia. This provides an opportunity for clinicians to detect these pre-cancerous conditions early and offer adequate cure or clinical monitoring before they progress to cancer. A camera test (gastroscopy) is the gold-standard test to detect pre-cancerous diseases in these organs. There has been limited research to set the standards for performance of a gastroscopy, especially with regards to diagnosis of pre-cancerous conditions, which require knowledge and skills by the physician performing the test (endoscopist). Therefore, the hypothesis behind this study is that the aforementioned pre-cancerous diseases are understudied and often go undetected. This study aims to understand how often endoscopists should diagnose these pre-cancerous diseases on routine gastroscopy and help define the standards to measure performance. The investigators will assess the following rates: i. how often endoscopists diagnose these pre-cancerous lesions during endoscopy; ii. How often these conditions are diagnosed on biopsies taken according to a standardized protocol; iii. How often these condition should have been diagnosed by the endoscopists based on the review of pictures by expert endoscopists. The investigators will also compare the rates of correct diagnosis by endoscopists with different levels of experience and based on the times spent to complete the diagnostic test. Investigating these aspects will enhance the understanding of the medical community with regards to the diagnosis of these pre-cancerous lesions and set endoscopy standards to improve their early detection and treatment before they progress to cancer. This will translate to improved cancer prevention and benefit for patients.

Dataset Information

Handling over-dispersion of performance indicators.

Objectives

Design

Setting

Results

Conclusion

Publications

Handling over-dispersion of performance indicators.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets