Dataset Information

Was Rodney Ledward a statistical outlier? Retrospective analysis using routine hospital data to identify gynaecologists' performance.

ABSTRACT:

Objectives

To investigate whether routinely collected data from hospital episode statistics could be used to identify the gynaecologist Rodney Ledward, who was suspended in 1966 and was the subject of the Ritchie inquiry into quality and practice within the NHS.

Design

A mixed scanning approach was used to identify seven variables from hospital episode statistics that were likely to be associated with potentially poor performance. A blinded multivariate analysis was undertaken to determine the distance (known as the Mahalanobis distance) in the seven indicator multidimensional space that each consultant was from the average consultant in each year. The change in Mahalanobis distance over time was also investigated by using a mixed effects model.

Setting

NHS hospital trusts in two English regions, in the five years from 1991-2 to 1995-6. Population Gynaecology consultants (n = 143) and their hospital episode statistics data.

Main outcome measure

Whether Ledward was a statistical outlier at the 95% level.

Results

The proportion of consultants who were outliers in any one year (at the 95% significance level) ranged from 9% to 20%. Ledward appeared as an outlier in three of the five years. Our mixed effects (multi-year) model identified nine high outlier consultants, including Ledward.

Conclusion

It was possible to identify Ledward as an outlier by using hospital episode statistics data. Although our method found other outlier consultants, we strongly caution that these outliers should not be overinterpreted as indicative of "poor" performance. Instead, a scientific search for a credible explanation should be undertaken, but this was outside the remit of our study. The set of indicators used means that cancer specialists, for example, are likely to have high values for several indicators, and the approach needs to be refined to deal with case mix variation. Even after allowing for that, the interpretation of outlier status is still as yet unclear. Further prospective evaluation of our method is warranted, but our overall approach may be potentially useful in other settings, especially where performance entails several indicator variables.

SUBMITTER: Harley M

PROVIDER: S-EPMC556335 | biostudies-literature | 2005 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Was Rodney Ledward a statistical outlier? Retrospective analysis using routine hospital data to identify gynaecologists' performance.

Harley Mike M Mohammed Mohammed A MA Hussain Shakir S Yates John J Almasri Abdullah A

BMJ (Clinical research ed.) 20050415 7497

<h4>Objectives</h4>To investigate whether routinely collected data from hospital episode statistics could be used to identify the gynaecologist Rodney Ledward, who was suspended in 1966 and was the subject of the Ritchie inquiry into quality and practice within the NHS.<h4>Design</h4>A mixed scanning approach was used to identify seven variables from hospital episode statistics that were likely to be associated with potentially poor performance. A blinded multivariate analysis was undertaken to ...[more]

PMID: 15833750

Similar Datasets

Project description:BackgroundInstitutions or clinicians (units) are often compared according to a performance indicator such as in-hospital mortality. Several approaches have been proposed for the detection of outlying units, whose performance deviates from the overall performance.MethodsWe provide an overview of three approaches commonly used to monitor institutional performances for outlier detection. These are the common-mean model, the 'Normal-Poisson' random effects model and the 'Logistic' random effects model. For the latter we also propose a visualisation technique. The common-mean model assumes that the underlying true performance of all units is equal and that any observed variation between units is due to chance. Even after applying case-mix adjustment, this assumption is often violated due to overdispersion and a post-hoc correction may need to be applied. The random effects models relax this assumption and explicitly allow the true performance to differ between units, thus offering a more flexible approach. We discuss the strengths and weaknesses of each approach and illustrate their application using audit data from England and Wales on Adult Cardiac Surgery (ACS) and Percutaneous Coronary Intervention (PCI).ResultsIn general, the overdispersion-corrected common-mean model and the random effects approaches produced similar p-values for the detection of outliers. For the ACS dataset (41 hospitals) three outliers were identified in total but only one was identified by all methods above. For the PCI dataset (88 hospitals), seven outliers were identified in total but only two were identified by all methods. The common-mean model uncorrected for overdispersion produced several more outliers. The reason for observing similar p-values for all three approaches could be attributed to the fact that the between-hospital variance was relatively small in both datasets, resulting only in a mild violation of the common-mean assumption; in this situation, the overdispersion correction worked well.ConclusionIf the common-mean assumption is likely to hold, all three methods are appropriate to use for outlier detection and their results should be similar. Random effect methods may be the preferred approach when the common-mean assumption is likely to be violated.

Project description:BackgroundSevere neuropsychiatric outcomes have been reported in individuals exposed to isotretinoin, but the evidence is inconclusive and complicated by several methodological limitations.ObjectivesTo establish and quantify the association between isotretinoin use for acne and 1-year incident neuropsychiatric adverse outcomes.MethodsA propensity score-matched cohort study of electronic medical records between the years 2013 and 2019 with patients followed up for 1 year after their index dispensed prescription was conducted. The database included over 12 million patients aged 12-27 years. We analysed data for individuals with acne in this age range with a dispensed prescription for isotretinoin or a control prescription. Outcomes included diagnoses of any incident sleep or mental health disorder, or nonfatal self-harm within 1 year of the index prescription.ResultsWe included 30 866 patients prescribed isotretinoin for their acne, 44 748 prescribed oral antibiotics, 108 367 prescribed topical anti-acne agents and 78 666 patients with acne but without an anti-acne prescription. After propensity score matching for baseline confounders, the odds ratio (OR) for any incident neuropsychiatric outcomes in patients with acne exposed to isotretinoin was 0·80 [95% confidence interval (CI) 0·74-0·87] compared with those on oral antibiotics; 0·94 (95% CI 0·87-1·02) compared with those using topical anti-acne medicines; and 1·06 (95% CI 0·97-1·16) compared with those without a prescription for anti-acne medicines. Patients exposed to isotretinoin experienced significantly more incident physical symptoms than patients in any of the three comparison cohorts.ConclusionsIsotretinoin was not independently associated with excess adverse neuropsychiatric outcomes at the population level. When monitoring potential adverse outcomes during isotretinoin treatment, clinicians should also consider the high mental health burden associated with treatment-resistant acne and the potential contribution of physical side-effects of prescribed medication on mental health.

Project description:INTRODUCTION:Prostate cancer is the most common cancer in men in the UK, with nearly 40?000 diagnosed in 2014; and it is the second most common cause of male cancer-related mortality. The clinical conundrum is that most men live with prostate cancer rather than die from it, while existing treatments have significant associated morbidity. Recent studies have shown very low mortality rates (1% after a median of 10-year follow-up) and no treatment-related reductions in mortality, in men with localised prostate cancer. This study will identify prognostic factors associated with prostate cancer progression to help differentiate aggressive from more indolent tumours in men with localised disease at diagnosis, and so inform the decision to adopt conservative (active surveillance) or radical (surgery or radiotherapy) management strategies. METHODS AND ANALYSIS:The Clinical Practice Research Datalink (CPRD) contains 57?318 men who were diagnosed with prostate cancer between 1 January 1987 and 31 December 2016. These men will be linked to the Office for National Statistics (ONS) and the National Cancer Registration and Analysis Service registry databases for mortality, TNM stage, Gleason grade and treatment data. Men with a diagnosis date prior to 1 January 1987 and men with lymph node or distant metastases at diagnosis will be excluded. A priori determined prognostic factors potentially associated with prostate cancer mortality, the end point of cancer progression, will be measured at baseline, and the participants followed through to development of cancer progression, death or the end of the follow-up period (31 December 2016). Cox proportional hazards regression will be used to estimate crude and mutually adjusted HRs. Mortality risk will be predicted using flexible parametric survival models that can accurately fit the shape of the hazard function. ETHICS AND DISSEMINATION:This study protocol has approval from the Independent Scientific Advisory Committee for the UK Medicines and Healthcare products Regulatory Agency Database Research (protocol 17_041). The findings will be presented in peer-reviewed journals and local CPRD researcher meetings.

Project description:Older patients who are at risk of poor healthcare outcomes should be recognised early during hospital admission to allow appropriate interventions. It is unclear whether routinely collected data can identify high-risk patients. The aim of this study was to define current practice with regard to the identification of older patients at high risk of poor healthcare outcomes on admission to hospital.Interviews/focus groups were conducted to establish the views of 22 healthcare staff across five acute medicine for older people wards in one hospital including seven nurses, four dieticians, seven doctors, and four therapists. In addition, a random sample of 60 patients' clinical records were reviewed to characterise the older patients, identify risk assessments performed routinely on admission, and describe usual care. We found that staff relied on their clinical judgment to identify high risk patients which was influenced by a number of factors such as reasons for admission, staff familiarity with patients, patients' general condition, visible frailty, and patients' ability to manage at home. "Therapy assessment" and patients' engagement with therapy were also reported to be important in recognising high-risk patients. However, staff recognised that making clinical judgments was often difficult and that it might occur several days after admission potentially delaying specific interventions. Routine risk assessments carried out on admission to identify single healthcare needs included risk of malnutrition (completed for 85% patients), falls risk (95%), moving and handling assessments (85%), and pressure ulcer risk assessments (88%). These were not used collectively to highlight patients at risk of poor healthcare outcomes. Thus, patients at risk of poor healthcare outcomes were not explicitly identified on admission using routinely collected data. There is a need for an early identification of these patients using a valid measure alongside staff clinical judgment to allow timely interventions to improve healthcare outcomes.

Project description:Identifying host factors that influence infectious disease transmission is an important step toward developing interventions to reduce disease incidence. Recent advances in methods for reconstructing infectious disease transmission events using pathogen genomic and epidemiological data open the door for investigation of host factors that affect onward transmission. While most transmission reconstruction methods are designed to work with densely sampled outbreaks, these methods are making their way into surveillance studies, where the fraction of sampled cases with sequenced pathogens could be relatively low. Surveillance studies that use transmission event reconstruction then use the reconstructed events as response variables (i.e., infection source status of each sampled case) and use host characteristics as predictors (e.g., presence of HIV infection) in regression models. We use simulations to study estimation of the effect of a host factor on probability of being an infection source via this multi-step inferential procedure. Using TransPhylo-a widely-used method for Bayesian estimation of infectious disease transmission events-and logistic regression, we find that low sensitivity of identifying infection sources leads to dilution of the signal, biasing logistic regression coefficients toward zero. We show that increasing the proportion of sampled cases improves sensitivity and some, but not all properties of the logistic regression inference. Application of these approaches to real world data from a population-based TB study in Botswana fails to detect an association between HIV infection and probability of being a TB infection source. We conclude that application of a pipeline, where one first uses TransPhylo and sparsely sampled surveillance data to infer transmission events and then estimates effects of host characteristics on probabilities of these events, should be accompanied by a realistic simulation study to better understand biases stemming from imprecise transmission event inference.

Dataset Information

Was Rodney Ledward a statistical outlier? Retrospective analysis using routine hospital data to identify gynaecologists' performance.

Objectives

Design

Setting

Main outcome measure

Results

Conclusion

Publications

Was Rodney Ledward a statistical outlier? Retrospective analysis using routine hospital data to identify gynaecologists' performance.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets