Dataset Information

Rapid evaluation for health and social care innovations: challenges for "quick wins" using interrupted time series.

ABSTRACT: BACKGROUND:Rapid evaluation was at the heart of National Health Service England's evaluation strategy of the new models of care vanguard programme. This was to facilitate the scale and spread of successful models of care throughout the health & social care system. The aim of this paper is to compare the findings of the two evaluations of the Enhanced health in Care Homes (EHCH) vanguard in Gateshead, one using a smaller data set for rapidity and one using a larger longitudinal data set and to investigate the implications of the use of rapid evaluations using interrupted time series (ITS) methods. METHODS:A quasi-experimental design study in the form of an ITS was used to evaluate the impact of the vanguard on secondary care use. Two different models are presented differing by timeframes only. The short-term model consisted of data for 11?months data pre and 20?months post vanguard. The long-term model consisted of data for 23?months pre and 34?months post vanguard. RESULTS:The cost consequences, including the cost of running the EHCH vanguard, were estimated using both a single tariff non-elective admissions methodology and a tariff per bed day methodology. The short-term model estimated a monthly cost increase of £73,408 using a single tariff methodology. When using a tariff per bed day, there was an estimated monthly cost increase of £14,315. The long-term model had, using a single tariff for non-elective admissions, an overall cost increase of £7576 per month. However, when using a tariff per bed-days, there was an estimated monthly cost reduction of £57,168. CONCLUSIONS:Although it is acknowledged that there is often a need for rapid evaluations in order to identify "quick wins" and to expedite learning within health and social care systems, we conclude that this may not be appropriate for quasi-experimental designs estimating effect using ITS for complex interventions. Our analyses suggests that care must be taken when conducting and interpreting the results of short-term evaluations using ITS methods, as they may produce misleading results and may lead to a misallocation of resources.

SUBMITTER: McCarthy A

PROVIDER: S-EPMC6911271 | biostudies-literature | 2019 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Rapid evaluation for health and social care innovations: challenges for "quick wins" using interrupted time series.

McCarthy Andrew A McMeekin Peter P Haining Shona S Bainbridge Lesley L Laing Claire C Gray Joanne J

BMC health services research 20191213 1

<h4>Background</h4>Rapid evaluation was at the heart of National Health Service England's evaluation strategy of the new models of care vanguard programme. This was to facilitate the scale and spread of successful models of care throughout the health & social care system. The aim of this paper is to compare the findings of the two evaluations of the Enhanced health in Care Homes (EHCH) vanguard in Gateshead, one using a smaller data set for rapidity and one using a larger longitudinal data set a ...[more]

PMID: 31836001

Similar Datasets

Project description:BackgroundInternationally, smoking prevalence among people in prison custody (ie, people on remand awaiting trial, awaiting sentencing, or serving a custodial sentence) is high. In Scotland, all prisons implemented a comprehensive smoke-free policy in 2018 after a 16-month anticipatory period. In this study, we aimed to use data on medication dispensing to assess the impact of this policy on cessation support, health outcomes, and potential unintended consequences among people in prison custody.MethodsWe did an interrupted time-series analysis using dispensing data for 44 660 individuals incarcerated in 14 closed prisons in Scotland between March 30, 2014, and Nov 30, 2019. We estimated changes in dispensing rates associated with the policy announcement (July 17, 2017) and full implementation (Nov 30, 2018) using seasonal autoregressive integrated moving average models. Medication categories of primary interest were treatments for nicotine dependence (as an indicator of smoking cessation or abstinence attempts), acute smoking-associated illnesses, and mental health (antidepressants). We included antiepileptic medications as a negative control.FindingsA 44% step increase in dispensing of treatments for nicotine dependence was observed at implementation (2250 items per 1000 people in custody per fortnight, 95% CI 1875 to 2624) due primarily to a 42% increase in dispensing of nicotine replacement therapy (2109 items per 1000 people in custody per fortnight, 1701 to 2516). A 9% step decrease in dispensing for smoking-related illnesses was observed at implementation, largely accounted for by respiratory medications (-646 items per 1000 people in custody per fortnight, -1111 to -181). No changes associated with announcement or implementation were observed for mental health dispensing or antiepileptic medications (control).InterpretationSmoke-free prison policies might improve respiratory health among people in custody and encourage smoking abstinence or cessation without apparent short-term adverse effects on mental health dispensing.FundingNational Institute of Health Research Public Health Research programme, Scottish Government Chief Scientist Office, and UK Medical Research Council.

Dataset Information

Rapid evaluation for health and social care innovations: challenges for "quick wins" using interrupted time series.

Publications

Rapid evaluation for health and social care innovations: challenges for "quick wins" using interrupted time series.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets